May 27 20:58:21.529701 np0000001553 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service. May 27 20:58:23.363990 np0000001553 nova-compute[98213]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=98213) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} May 27 20:58:23.364468 np0000001553 nova-compute[98213]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=98213) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} May 27 20:58:23.364468 np0000001553 nova-compute[98213]: INFO os_vif [-] Loaded VIF plugins: noop, ovs May 27 20:58:23.490097 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 20:58:23.503858 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.014s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 20:58:23.659271 np0000001553 nova-compute[98213]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative May 27 20:58:24.472427 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks. May 27 20:58:24.472829 np0000001553 nova-compute[98213]: INFO nova.utils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] The long task thread pool MainProcess.long_task is initialized May 27 20:58:24.472876 np0000001553 nova-compute[98213]: INFO nova.virt.driver [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Loading compute driver 'libvirt.LibvirtDriver' May 27 20:58:24.565817 np0000001553 nova-compute[98213]: INFO nova.compute.provider_config [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. May 27 20:58:25.067913 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Acquiring lock "singleton_lock" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 20:58:25.068076 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Acquired lock "singleton_lock" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 20:58:25.068237 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Releasing lock "singleton_lock" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 20:58:25.068409 np0000001553 nova-compute[98213]: WARNING oslo_service.backend._threading.service [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] no_fork=True: running service in main process May 27 20:58:25.068660 np0000001553 nova-compute[98213]: INFO nova.service [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Starting compute node (version 33.1.0) May 27 20:58:25.571542 np0000001553 nova-compute[98213]: INFO nova.utils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] The default thread pool MainProcess.default is initialized May 27 20:58:25.572297 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 20:58:25.572602 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Starting event thread {{(pid=98213) start /opt/stack/nova/nova/virt/libvirt/host.py:252}} May 27 20:58:25.573013 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Starting connection event dispatch thread {{(pid=98213) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}} May 27 20:58:25.573701 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Connecting to libvirt: qemu:///system {{(pid=98213) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}} May 27 20:58:26.251872 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Registering for lifecycle events {{(pid=98213) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}} May 27 20:58:26.254742 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Registering for connection events: {{(pid=98213) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}} May 27 20:58:26.255415 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Connection event '1' reason 'None' May 27 20:58:26.758326 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Cannot update service status on host "np0000001553" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001553 could not be found. May 27 20:58:26.758326 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.mount [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Initialising _HostMountState generation 0 {{(pid=98213) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} May 27 20:58:37.100707 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host capabilities May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: 2a3a3b7f-76de-4583-8ff1-830f427a798c May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: x86_64 May 27 20:58:37.100707 np0000001553 nova-compute[98213]: EPYC-Milan May 27 20:58:37.100707 np0000001553 nova-compute[98213]: AMD May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: tcp May 27 20:58:37.100707 np0000001553 nova-compute[98213]: rdma May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.100707 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: 24607188 May 27 20:58:37.102113 np0000001553 nova-compute[98213]: 6151797 May 27 20:58:37.102113 np0000001553 nova-compute[98213]: 0 May 27 20:58:37.102113 np0000001553 nova-compute[98213]: 0 May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102113 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: apparmor May 27 20:58:37.102763 np0000001553 nova-compute[98213]: 0 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: dac May 27 20:58:37.102763 np0000001553 nova-compute[98213]: 0 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: +64055:+993 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: +64055:+993 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-alpha May 27 20:58:37.102763 np0000001553 nova-compute[98213]: clipper May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.102763 np0000001553 nova-compute[98213]: May 27 20:58:37.102763 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-arm May 27 20:58:37.102763 np0000001553 nova-compute[98213]: virt-8.2 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: virt May 27 20:58:37.102763 np0000001553 nova-compute[98213]: qcom-dc-scm-v1-bmc May 27 20:58:37.102763 np0000001553 nova-compute[98213]: mori-bmc May 27 20:58:37.102763 np0000001553 nova-compute[98213]: ast2600-evb May 27 20:58:37.102763 np0000001553 nova-compute[98213]: borzoi May 27 20:58:37.102763 np0000001553 nova-compute[98213]: tiogapass-bmc May 27 20:58:37.102763 np0000001553 nova-compute[98213]: spitz May 27 20:58:37.102763 np0000001553 nova-compute[98213]: virt-2.7 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: nuri May 27 20:58:37.102763 np0000001553 nova-compute[98213]: mcimx7d-sabre May 27 20:58:37.102763 np0000001553 nova-compute[98213]: romulus-bmc May 27 20:58:37.102763 np0000001553 nova-compute[98213]: virt-3.0 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: virt-5.0 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: npcm750-evb May 27 20:58:37.102763 np0000001553 nova-compute[98213]: virt-2.10 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: rainier-bmc May 27 20:58:37.102763 np0000001553 nova-compute[98213]: mps3-an547 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: musca-b1 May 27 20:58:37.102763 np0000001553 nova-compute[98213]: realview-pbx-a9 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: versatileab May 27 20:58:37.104895 np0000001553 nova-compute[98213]: kzm May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-2.8 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: fby35-bmc May 27 20:58:37.104895 np0000001553 nova-compute[98213]: musca-a May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-3.1 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: mcimx6ul-evk May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-5.1 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: smdkc210 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: sx1 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-2.11 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: imx25-pdk May 27 20:58:37.104895 np0000001553 nova-compute[98213]: stm32vldiscovery May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-2.9 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: orangepi-pc May 27 20:58:37.104895 np0000001553 nova-compute[98213]: quanta-q71l-bmc May 27 20:58:37.104895 np0000001553 nova-compute[98213]: z2 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-5.2 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: xilinx-zynq-a9 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: tosa May 27 20:58:37.104895 np0000001553 nova-compute[98213]: mps2-an500 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-2.12 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: mps2-an521 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: sabrelite May 27 20:58:37.104895 np0000001553 nova-compute[98213]: mps2-an511 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: canon-a1100 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: realview-eb May 27 20:58:37.104895 np0000001553 nova-compute[98213]: quanta-gbs-bmc May 27 20:58:37.104895 np0000001553 nova-compute[98213]: emcraft-sf2 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: realview-pb-a8 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: yosemitev2-bmc May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-7.0 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-4.0 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: raspi1ap May 27 20:58:37.104895 np0000001553 nova-compute[98213]: palmetto-bmc May 27 20:58:37.104895 np0000001553 nova-compute[98213]: sx1-v1 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: n810 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: g220a-bmc May 27 20:58:37.104895 np0000001553 nova-compute[98213]: n800 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: bletchley-bmc May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-7.1 May 27 20:58:37.104895 np0000001553 nova-compute[98213]: tacoma-bmc May 27 20:58:37.104895 np0000001553 nova-compute[98213]: virt-4.1 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: quanta-gsj May 27 20:58:37.106488 np0000001553 nova-compute[98213]: versatilepb May 27 20:58:37.106488 np0000001553 nova-compute[98213]: terrier May 27 20:58:37.106488 np0000001553 nova-compute[98213]: mainstone May 27 20:58:37.106488 np0000001553 nova-compute[98213]: realview-eb-mpcore May 27 20:58:37.106488 np0000001553 nova-compute[98213]: integratorcp May 27 20:58:37.106488 np0000001553 nova-compute[98213]: virt-7.2 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: supermicrox11-bmc May 27 20:58:37.106488 np0000001553 nova-compute[98213]: virt-4.2 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: witherspoon-bmc May 27 20:58:37.106488 np0000001553 nova-compute[98213]: qcom-firework-bmc May 27 20:58:37.106488 np0000001553 nova-compute[98213]: mps3-an524 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: kudo-bmc May 27 20:58:37.106488 np0000001553 nova-compute[98213]: vexpress-a9 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: midway May 27 20:58:37.106488 np0000001553 nova-compute[98213]: musicpal May 27 20:58:37.106488 np0000001553 nova-compute[98213]: lm3s811evb May 27 20:58:37.106488 np0000001553 nova-compute[98213]: lm3s6965evb May 27 20:58:37.106488 np0000001553 nova-compute[98213]: supermicro-x11spi-bmc May 27 20:58:37.106488 np0000001553 nova-compute[98213]: microbit May 27 20:58:37.106488 np0000001553 nova-compute[98213]: fby35 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: mps2-an505 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: mps2-an385 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: virt-6.0 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: virt-8.0 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: cubieboard May 27 20:58:37.106488 np0000001553 nova-compute[98213]: ast1030-evb May 27 20:58:37.106488 np0000001553 nova-compute[98213]: verdex May 27 20:58:37.106488 np0000001553 nova-compute[98213]: bpim2u May 27 20:58:37.106488 np0000001553 nova-compute[98213]: netduino2 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: mps2-an386 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: olimex-stm32-h405 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: virt-6.1 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: virt-8.1 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: raspi2b May 27 20:58:37.106488 np0000001553 nova-compute[98213]: vexpress-a15 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: fuji-bmc May 27 20:58:37.106488 np0000001553 nova-compute[98213]: virt-6.2 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: sonorapass-bmc May 27 20:58:37.106488 np0000001553 nova-compute[98213]: cheetah May 27 20:58:37.106488 np0000001553 nova-compute[98213]: virt-2.6 May 27 20:58:37.106488 np0000001553 nova-compute[98213]: ast2500-evb May 27 20:58:37.107636 np0000001553 nova-compute[98213]: highbank May 27 20:58:37.107636 np0000001553 nova-compute[98213]: akita May 27 20:58:37.107636 np0000001553 nova-compute[98213]: connex May 27 20:58:37.107636 np0000001553 nova-compute[98213]: netduinoplus2 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: collie May 27 20:58:37.107636 np0000001553 nova-compute[98213]: raspi0 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: fp5280g2-bmc May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.107636 np0000001553 nova-compute[98213]: May 27 20:58:37.107636 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-arm May 27 20:58:37.107636 np0000001553 nova-compute[98213]: virt-8.2 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: virt May 27 20:58:37.107636 np0000001553 nova-compute[98213]: qcom-dc-scm-v1-bmc May 27 20:58:37.107636 np0000001553 nova-compute[98213]: mori-bmc May 27 20:58:37.107636 np0000001553 nova-compute[98213]: ast2600-evb May 27 20:58:37.107636 np0000001553 nova-compute[98213]: borzoi May 27 20:58:37.107636 np0000001553 nova-compute[98213]: tiogapass-bmc May 27 20:58:37.107636 np0000001553 nova-compute[98213]: spitz May 27 20:58:37.107636 np0000001553 nova-compute[98213]: virt-2.7 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: nuri May 27 20:58:37.107636 np0000001553 nova-compute[98213]: mcimx7d-sabre May 27 20:58:37.107636 np0000001553 nova-compute[98213]: romulus-bmc May 27 20:58:37.107636 np0000001553 nova-compute[98213]: virt-3.0 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: virt-5.0 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: npcm750-evb May 27 20:58:37.107636 np0000001553 nova-compute[98213]: virt-2.10 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: rainier-bmc May 27 20:58:37.107636 np0000001553 nova-compute[98213]: mps3-an547 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: musca-b1 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: realview-pbx-a9 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: versatileab May 27 20:58:37.107636 np0000001553 nova-compute[98213]: kzm May 27 20:58:37.107636 np0000001553 nova-compute[98213]: virt-2.8 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: fby35-bmc May 27 20:58:37.107636 np0000001553 nova-compute[98213]: musca-a May 27 20:58:37.107636 np0000001553 nova-compute[98213]: virt-3.1 May 27 20:58:37.107636 np0000001553 nova-compute[98213]: mcimx6ul-evk May 27 20:58:37.107636 np0000001553 nova-compute[98213]: virt-5.1 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: smdkc210 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: sx1 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: virt-2.11 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: imx25-pdk May 27 20:58:37.108333 np0000001553 nova-compute[98213]: stm32vldiscovery May 27 20:58:37.108333 np0000001553 nova-compute[98213]: virt-2.9 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: orangepi-pc May 27 20:58:37.108333 np0000001553 nova-compute[98213]: quanta-q71l-bmc May 27 20:58:37.108333 np0000001553 nova-compute[98213]: z2 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: virt-5.2 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: xilinx-zynq-a9 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: tosa May 27 20:58:37.108333 np0000001553 nova-compute[98213]: mps2-an500 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: virt-2.12 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: mps2-an521 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: sabrelite May 27 20:58:37.108333 np0000001553 nova-compute[98213]: mps2-an511 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: canon-a1100 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: realview-eb May 27 20:58:37.108333 np0000001553 nova-compute[98213]: quanta-gbs-bmc May 27 20:58:37.108333 np0000001553 nova-compute[98213]: emcraft-sf2 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: realview-pb-a8 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: yosemitev2-bmc May 27 20:58:37.108333 np0000001553 nova-compute[98213]: virt-7.0 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: virt-4.0 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: raspi1ap May 27 20:58:37.108333 np0000001553 nova-compute[98213]: palmetto-bmc May 27 20:58:37.108333 np0000001553 nova-compute[98213]: sx1-v1 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: n810 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: g220a-bmc May 27 20:58:37.108333 np0000001553 nova-compute[98213]: n800 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: bletchley-bmc May 27 20:58:37.108333 np0000001553 nova-compute[98213]: virt-7.1 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: tacoma-bmc May 27 20:58:37.108333 np0000001553 nova-compute[98213]: virt-4.1 May 27 20:58:37.108333 np0000001553 nova-compute[98213]: quanta-gsj May 27 20:58:37.108333 np0000001553 nova-compute[98213]: versatilepb May 27 20:58:37.108333 np0000001553 nova-compute[98213]: terrier May 27 20:58:37.108333 np0000001553 nova-compute[98213]: mainstone May 27 20:58:37.108333 np0000001553 nova-compute[98213]: realview-eb-mpcore May 27 20:58:37.108333 np0000001553 nova-compute[98213]: integratorcp May 27 20:58:37.108333 np0000001553 nova-compute[98213]: virt-7.2 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: supermicrox11-bmc May 27 20:58:37.110056 np0000001553 nova-compute[98213]: virt-4.2 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: witherspoon-bmc May 27 20:58:37.110056 np0000001553 nova-compute[98213]: qcom-firework-bmc May 27 20:58:37.110056 np0000001553 nova-compute[98213]: mps3-an524 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: kudo-bmc May 27 20:58:37.110056 np0000001553 nova-compute[98213]: vexpress-a9 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: midway May 27 20:58:37.110056 np0000001553 nova-compute[98213]: musicpal May 27 20:58:37.110056 np0000001553 nova-compute[98213]: lm3s811evb May 27 20:58:37.110056 np0000001553 nova-compute[98213]: lm3s6965evb May 27 20:58:37.110056 np0000001553 nova-compute[98213]: supermicro-x11spi-bmc May 27 20:58:37.110056 np0000001553 nova-compute[98213]: microbit May 27 20:58:37.110056 np0000001553 nova-compute[98213]: fby35 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: mps2-an505 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: mps2-an385 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: virt-6.0 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: virt-8.0 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: cubieboard May 27 20:58:37.110056 np0000001553 nova-compute[98213]: ast1030-evb May 27 20:58:37.110056 np0000001553 nova-compute[98213]: verdex May 27 20:58:37.110056 np0000001553 nova-compute[98213]: bpim2u May 27 20:58:37.110056 np0000001553 nova-compute[98213]: netduino2 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: mps2-an386 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: olimex-stm32-h405 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: virt-6.1 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: virt-8.1 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: raspi2b May 27 20:58:37.110056 np0000001553 nova-compute[98213]: vexpress-a15 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: fuji-bmc May 27 20:58:37.110056 np0000001553 nova-compute[98213]: virt-6.2 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: sonorapass-bmc May 27 20:58:37.110056 np0000001553 nova-compute[98213]: cheetah May 27 20:58:37.110056 np0000001553 nova-compute[98213]: virt-2.6 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: ast2500-evb May 27 20:58:37.110056 np0000001553 nova-compute[98213]: highbank May 27 20:58:37.110056 np0000001553 nova-compute[98213]: akita May 27 20:58:37.110056 np0000001553 nova-compute[98213]: connex May 27 20:58:37.110056 np0000001553 nova-compute[98213]: netduinoplus2 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: collie May 27 20:58:37.110056 np0000001553 nova-compute[98213]: raspi0 May 27 20:58:37.110056 np0000001553 nova-compute[98213]: fp5280g2-bmc May 27 20:58:37.110056 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.110882 np0000001553 nova-compute[98213]: May 27 20:58:37.110882 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-aarch64 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt-8.2 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt May 27 20:58:37.110882 np0000001553 nova-compute[98213]: qcom-dc-scm-v1-bmc May 27 20:58:37.110882 np0000001553 nova-compute[98213]: mori-bmc May 27 20:58:37.110882 np0000001553 nova-compute[98213]: ast2600-evb May 27 20:58:37.110882 np0000001553 nova-compute[98213]: borzoi May 27 20:58:37.110882 np0000001553 nova-compute[98213]: tiogapass-bmc May 27 20:58:37.110882 np0000001553 nova-compute[98213]: spitz May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt-2.7 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: nuri May 27 20:58:37.110882 np0000001553 nova-compute[98213]: mcimx7d-sabre May 27 20:58:37.110882 np0000001553 nova-compute[98213]: romulus-bmc May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt-3.0 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt-5.0 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: npcm750-evb May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt-2.10 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: rainier-bmc May 27 20:58:37.110882 np0000001553 nova-compute[98213]: mps3-an547 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt-2.8 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: musca-b1 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: realview-pbx-a9 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: versatileab May 27 20:58:37.110882 np0000001553 nova-compute[98213]: kzm May 27 20:58:37.110882 np0000001553 nova-compute[98213]: fby35-bmc May 27 20:58:37.110882 np0000001553 nova-compute[98213]: musca-a May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt-3.1 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: mcimx6ul-evk May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt-5.1 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: smdkc210 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: sx1 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt-2.11 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: imx25-pdk May 27 20:58:37.110882 np0000001553 nova-compute[98213]: stm32vldiscovery May 27 20:58:37.110882 np0000001553 nova-compute[98213]: virt-2.9 May 27 20:58:37.110882 np0000001553 nova-compute[98213]: orangepi-pc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: quanta-q71l-bmc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: z2 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: virt-5.2 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: xilinx-zynq-a9 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: xlnx-zcu102 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: tosa May 27 20:58:37.111630 np0000001553 nova-compute[98213]: mps2-an500 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: virt-2.12 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: mps2-an521 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: sabrelite May 27 20:58:37.111630 np0000001553 nova-compute[98213]: mps2-an511 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: canon-a1100 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: realview-eb May 27 20:58:37.111630 np0000001553 nova-compute[98213]: quanta-gbs-bmc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: emcraft-sf2 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: realview-pb-a8 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: sbsa-ref May 27 20:58:37.111630 np0000001553 nova-compute[98213]: yosemitev2-bmc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: virt-7.0 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: virt-4.0 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: raspi1ap May 27 20:58:37.111630 np0000001553 nova-compute[98213]: palmetto-bmc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: sx1-v1 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: n810 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: g220a-bmc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: n800 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: bletchley-bmc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: virt-7.1 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: tacoma-bmc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: virt-4.1 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: quanta-gsj May 27 20:58:37.111630 np0000001553 nova-compute[98213]: versatilepb May 27 20:58:37.111630 np0000001553 nova-compute[98213]: terrier May 27 20:58:37.111630 np0000001553 nova-compute[98213]: mainstone May 27 20:58:37.111630 np0000001553 nova-compute[98213]: realview-eb-mpcore May 27 20:58:37.111630 np0000001553 nova-compute[98213]: integratorcp May 27 20:58:37.111630 np0000001553 nova-compute[98213]: virt-7.2 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: supermicrox11-bmc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: virt-4.2 May 27 20:58:37.111630 np0000001553 nova-compute[98213]: witherspoon-bmc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: qcom-firework-bmc May 27 20:58:37.111630 np0000001553 nova-compute[98213]: mps3-an524 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: kudo-bmc May 27 20:58:37.113348 np0000001553 nova-compute[98213]: vexpress-a9 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: midway May 27 20:58:37.113348 np0000001553 nova-compute[98213]: musicpal May 27 20:58:37.113348 np0000001553 nova-compute[98213]: lm3s811evb May 27 20:58:37.113348 np0000001553 nova-compute[98213]: lm3s6965evb May 27 20:58:37.113348 np0000001553 nova-compute[98213]: supermicro-x11spi-bmc May 27 20:58:37.113348 np0000001553 nova-compute[98213]: microbit May 27 20:58:37.113348 np0000001553 nova-compute[98213]: fby35 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: mps2-an505 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: mps2-an385 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: virt-6.0 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: virt-8.0 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: raspi3ap May 27 20:58:37.113348 np0000001553 nova-compute[98213]: cubieboard May 27 20:58:37.113348 np0000001553 nova-compute[98213]: ast1030-evb May 27 20:58:37.113348 np0000001553 nova-compute[98213]: verdex May 27 20:58:37.113348 np0000001553 nova-compute[98213]: bpim2u May 27 20:58:37.113348 np0000001553 nova-compute[98213]: netduino2 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: xlnx-versal-virt May 27 20:58:37.113348 np0000001553 nova-compute[98213]: mps2-an386 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: olimex-stm32-h405 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: virt-6.1 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: virt-8.1 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: raspi3b May 27 20:58:37.113348 np0000001553 nova-compute[98213]: raspi2b May 27 20:58:37.113348 np0000001553 nova-compute[98213]: vexpress-a15 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: fuji-bmc May 27 20:58:37.113348 np0000001553 nova-compute[98213]: virt-6.2 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: sonorapass-bmc May 27 20:58:37.113348 np0000001553 nova-compute[98213]: cheetah May 27 20:58:37.113348 np0000001553 nova-compute[98213]: virt-2.6 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: ast2500-evb May 27 20:58:37.113348 np0000001553 nova-compute[98213]: highbank May 27 20:58:37.113348 np0000001553 nova-compute[98213]: akita May 27 20:58:37.113348 np0000001553 nova-compute[98213]: connex May 27 20:58:37.113348 np0000001553 nova-compute[98213]: netduinoplus2 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: collie May 27 20:58:37.113348 np0000001553 nova-compute[98213]: raspi0 May 27 20:58:37.113348 np0000001553 nova-compute[98213]: fp5280g2-bmc May 27 20:58:37.113348 np0000001553 nova-compute[98213]: May 27 20:58:37.113348 np0000001553 nova-compute[98213]: May 27 20:58:37.113348 np0000001553 nova-compute[98213]: May 27 20:58:37.113348 np0000001553 nova-compute[98213]: May 27 20:58:37.113348 np0000001553 nova-compute[98213]: May 27 20:58:37.113348 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-cris May 27 20:58:37.115052 np0000001553 nova-compute[98213]: axis-dev88 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.115052 np0000001553 nova-compute[98213]: May 27 20:58:37.115052 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-i386 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-noble-v2 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: ubuntu May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-q35-mantic May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-impish-hpb May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-q35-5.2 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-q35-lunar-hpb May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-mantic May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-2.12 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-2.0 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-xenial May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-q35-kinetic May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-6.2 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-q35-4.2 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-mantic-maxcpus May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-2.5 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-4.2 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-focal May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-hirsute May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-q35-xenial May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-jammy-hpb May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-5.2 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-q35-2.7 May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-q35-eoan-hpb May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-i440fx-disco-hpb May 27 20:58:37.115052 np0000001553 nova-compute[98213]: pc-q35-groovy May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-zesty May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-lunar May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-mantic-hpb-maxcpus May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-groovy May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-7.1 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-artful May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-trusty May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-2.2 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-eoan-hpb May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-focal-hpb May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-8.1 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-jammy-maxcpus May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-bionic-hpb May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-mantic-hpb May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-artful May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-8.1 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-2.7 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-6.1 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-kinetic May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-jammy-maxcpus May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-yakkety May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-2.4 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-cosmic-hpb May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-7.1 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-2.10 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: x-remote May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-5.1 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-2.9 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-2.11 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-jammy-hpb-maxcpus May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-3.1 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-6.1 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-4.1 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-jammy May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-2.4 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-i440fx-4.1 May 27 20:58:37.117068 np0000001553 nova-compute[98213]: pc-q35-eoan May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-jammy-hpb May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-5.1 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-2.9 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-bionic-hpb May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-lunar May 27 20:58:37.117801 np0000001553 nova-compute[98213]: isapc May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-mantic-hpb May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-cosmic May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-2.6 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-mantic-maxcpus May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-3.1 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-bionic May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-disco-hpb May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-cosmic May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-2.12 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-bionic May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-kinetic-hpb May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-groovy-hpb May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-7.0 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-noble-v2 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: ubuntu-q35 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-lunar-hpb May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-disco May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-cosmic-hpb May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-noble May 27 20:58:37.117801 np0000001553 nova-compute[98213]: q35 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-2.1 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-8.0 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-impish May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-wily May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-8.0 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-2.6 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-6.0 May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-impish May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-i440fx-jammy May 27 20:58:37.117801 np0000001553 nova-compute[98213]: pc-q35-impish-hpb May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-hirsute May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-4.0.1 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-hirsute-hpb May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-7.0 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-5.0 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-2.8 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-2.10 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-3.0 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-6.0 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-zesty May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-7.2 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-4.0 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-focal May 27 20:58:37.118448 np0000001553 nova-compute[98213]: microvm May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-2.3 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-jammy-hpb-maxcpus May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-8.2 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: q35 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-kinetic-hpb May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-focal-hpb May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-4.0 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-noble May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-disco May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-groovy-hpb May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-8.2 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-hirsute-hpb May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-5.0 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-6.2 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-2.8 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-eoan May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-2.5 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-3.0 May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-q35-yakkety May 27 20:58:37.118448 np0000001553 nova-compute[98213]: pc-i440fx-mantic-hpb-maxcpus May 27 20:58:37.118995 np0000001553 nova-compute[98213]: pc-i440fx-7.2 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: pc-q35-2.11 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-m68k May 27 20:58:37.118995 np0000001553 nova-compute[98213]: mcf5208evb May 27 20:58:37.118995 np0000001553 nova-compute[98213]: virt-7.0 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: an5206 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: virt-6.0 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: q800 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: virt-8.1 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: virt-7.2 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: virt-6.2 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: virt-8.0 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: next-cube May 27 20:58:37.118995 np0000001553 nova-compute[98213]: virt-7.1 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: virt-6.1 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: virt-8.2 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: virt May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-microblaze May 27 20:58:37.118995 np0000001553 nova-compute[98213]: petalogix-s3adsp1800 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: petalogix-ml605 May 27 20:58:37.118995 np0000001553 nova-compute[98213]: xlnx-zynqmp-pmu May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.118995 np0000001553 nova-compute[98213]: May 27 20:58:37.118995 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.120038 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-microblazeel May 27 20:58:37.120038 np0000001553 nova-compute[98213]: petalogix-s3adsp1800 May 27 20:58:37.120038 np0000001553 nova-compute[98213]: petalogix-ml605 May 27 20:58:37.120038 np0000001553 nova-compute[98213]: xlnx-zynqmp-pmu May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.120038 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-mips May 27 20:58:37.120038 np0000001553 nova-compute[98213]: malta May 27 20:58:37.120038 np0000001553 nova-compute[98213]: mipssim May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.120038 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-mipsel May 27 20:58:37.120038 np0000001553 nova-compute[98213]: malta May 27 20:58:37.120038 np0000001553 nova-compute[98213]: mipssim May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.120038 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-mips64 May 27 20:58:37.120038 np0000001553 nova-compute[98213]: malta May 27 20:58:37.120038 np0000001553 nova-compute[98213]: mipssim May 27 20:58:37.120038 np0000001553 nova-compute[98213]: pica61 May 27 20:58:37.120038 np0000001553 nova-compute[98213]: magnum May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.120038 np0000001553 nova-compute[98213]: May 27 20:58:37.120038 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.120038 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-mips64el May 27 20:58:37.120038 np0000001553 nova-compute[98213]: malta May 27 20:58:37.124156 np0000001553 nova-compute[98213]: loongson3-virt May 27 20:58:37.124156 np0000001553 nova-compute[98213]: mipssim May 27 20:58:37.124156 np0000001553 nova-compute[98213]: pica61 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: magnum May 27 20:58:37.124156 np0000001553 nova-compute[98213]: boston May 27 20:58:37.124156 np0000001553 nova-compute[98213]: fuloong2e May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-ppc May 27 20:58:37.124156 np0000001553 nova-compute[98213]: g3beige May 27 20:58:37.124156 np0000001553 nova-compute[98213]: amigaone May 27 20:58:37.124156 np0000001553 nova-compute[98213]: virtex-ml507 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: mac99 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: ppce500 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: sam460ex May 27 20:58:37.124156 np0000001553 nova-compute[98213]: pegasos2 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: bamboo May 27 20:58:37.124156 np0000001553 nova-compute[98213]: 40p May 27 20:58:37.124156 np0000001553 nova-compute[98213]: ref405ep May 27 20:58:37.124156 np0000001553 nova-compute[98213]: mpc8544ds May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.124156 np0000001553 nova-compute[98213]: May 27 20:58:37.124156 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-ppc64 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: pseries-noble May 27 20:58:37.124156 np0000001553 nova-compute[98213]: pseries May 27 20:58:37.124156 np0000001553 nova-compute[98213]: amigaone May 27 20:58:37.124156 np0000001553 nova-compute[98213]: powernv9 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: powernv May 27 20:58:37.124156 np0000001553 nova-compute[98213]: pseries-4.1 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: mpc8544ds May 27 20:58:37.124156 np0000001553 nova-compute[98213]: pseries-6.1 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: pseries-2.5 May 27 20:58:37.124156 np0000001553 nova-compute[98213]: powernv10 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-xenial May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-4.2 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-6.2 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-yakkety May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-2.6 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: ppce500 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-bionic-sxxm May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-2.7 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-3.0 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-8.0 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-5.0 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: 40p May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-lunar May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-2.8 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pegasos2 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-hirsute May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-3.1 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-8.1 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-5.1 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-eoan May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-2.9 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-zesty May 27 20:58:37.125941 np0000001553 nova-compute[98213]: bamboo May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-groovy May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-focal May 27 20:58:37.125941 np0000001553 nova-compute[98213]: g3beige May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-8.2 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-5.2 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-disco May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-2.12-sxxm May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-mantic May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-kinetic May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-2.10 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-7.0 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: virtex-ml507 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-2.11 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-2.1 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-7.1 May 27 20:58:37.125941 np0000001553 nova-compute[98213]: pseries-cosmic May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-bionic May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-2.12 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-2.2 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-7.2 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: mac99 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-impish May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-jammy May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-artful May 27 20:58:37.126615 np0000001553 nova-compute[98213]: sam460ex May 27 20:58:37.126615 np0000001553 nova-compute[98213]: ref405ep May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-2.3 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: powernv8 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-4.0 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-6.0 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-2.4 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.126615 np0000001553 nova-compute[98213]: May 27 20:58:37.126615 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-ppc64le May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-noble May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries May 27 20:58:37.126615 np0000001553 nova-compute[98213]: amigaone May 27 20:58:37.126615 np0000001553 nova-compute[98213]: powernv9 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: powernv May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-4.1 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: mpc8544ds May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-6.1 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-2.5 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: powernv10 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-xenial May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-4.2 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-6.2 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-yakkety May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-2.6 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: ppce500 May 27 20:58:37.126615 np0000001553 nova-compute[98213]: pseries-bionic-sxxm May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-2.7 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-3.0 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-8.0 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-5.0 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: 40p May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-lunar May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-2.8 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pegasos2 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-hirsute May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-3.1 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-8.1 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-5.1 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-eoan May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-2.9 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-zesty May 27 20:58:37.127949 np0000001553 nova-compute[98213]: bamboo May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-groovy May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-focal May 27 20:58:37.127949 np0000001553 nova-compute[98213]: g3beige May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-8.2 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-5.2 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-disco May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-2.12-sxxm May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-mantic May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-kinetic May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-2.10 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-7.0 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: virtex-ml507 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-2.11 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-2.1 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-7.1 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-cosmic May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-bionic May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-2.12 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-2.2 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-7.2 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: mac99 May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-impish May 27 20:58:37.127949 np0000001553 nova-compute[98213]: pseries-jammy May 27 20:58:37.129128 np0000001553 nova-compute[98213]: pseries-artful May 27 20:58:37.129128 np0000001553 nova-compute[98213]: sam460ex May 27 20:58:37.129128 np0000001553 nova-compute[98213]: ref405ep May 27 20:58:37.129128 np0000001553 nova-compute[98213]: pseries-2.3 May 27 20:58:37.129128 np0000001553 nova-compute[98213]: powernv8 May 27 20:58:37.129128 np0000001553 nova-compute[98213]: pseries-4.0 May 27 20:58:37.129128 np0000001553 nova-compute[98213]: pseries-6.0 May 27 20:58:37.129128 np0000001553 nova-compute[98213]: pseries-2.4 May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.129128 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-riscv32 May 27 20:58:37.129128 np0000001553 nova-compute[98213]: virt May 27 20:58:37.129128 np0000001553 nova-compute[98213]: spike May 27 20:58:37.129128 np0000001553 nova-compute[98213]: opentitan May 27 20:58:37.129128 np0000001553 nova-compute[98213]: sifive_u May 27 20:58:37.129128 np0000001553 nova-compute[98213]: sifive_e May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.129128 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-riscv64 May 27 20:58:37.129128 np0000001553 nova-compute[98213]: virt May 27 20:58:37.129128 np0000001553 nova-compute[98213]: spike May 27 20:58:37.129128 np0000001553 nova-compute[98213]: microchip-icicle-kit May 27 20:58:37.129128 np0000001553 nova-compute[98213]: sifive_u May 27 20:58:37.129128 np0000001553 nova-compute[98213]: shakti_c May 27 20:58:37.129128 np0000001553 nova-compute[98213]: sifive_e May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.129128 np0000001553 nova-compute[98213]: May 27 20:58:37.129128 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.129128 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-s390x May 27 20:58:37.129128 np0000001553 nova-compute[98213]: s390-ccw-virtio-noble May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-8.0 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-disco May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-6.0 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-2.11 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-7.0 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-mantic May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-xenial May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-5.0 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-focal May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-2.8 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-4.0 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-zesty May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-8.2 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-6.2 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-3.0 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-groovy May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-2.5 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-7.2 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-5.2 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-artful May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-hirsute May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-4.2 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-2.10 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-2.7 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-lunar May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-eoan May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-kinetic May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-8.1 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-yakkety May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-6.1 May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-cosmic May 27 20:58:37.130669 np0000001553 nova-compute[98213]: s390-ccw-virtio-bionic May 27 20:58:37.132376 np0000001553 nova-compute[98213]: s390-ccw-virtio-2.12 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: s390-ccw-virtio-7.1 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: s390-ccw-virtio-2.4 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: s390-ccw-virtio-5.1 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: s390-ccw-virtio-2.9 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: s390-ccw-virtio-impish May 27 20:58:37.132376 np0000001553 nova-compute[98213]: s390-ccw-virtio-4.1 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: s390-ccw-virtio-jammy May 27 20:58:37.132376 np0000001553 nova-compute[98213]: s390-ccw-virtio-3.1 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: s390-ccw-virtio-2.6 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-sh4 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: shix May 27 20:58:37.132376 np0000001553 nova-compute[98213]: r2d May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-sh4eb May 27 20:58:37.132376 np0000001553 nova-compute[98213]: shix May 27 20:58:37.132376 np0000001553 nova-compute[98213]: r2d May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.132376 np0000001553 nova-compute[98213]: May 27 20:58:37.132376 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-sparc May 27 20:58:37.132376 np0000001553 nova-compute[98213]: SS-5 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: SS-20 May 27 20:58:37.132376 np0000001553 nova-compute[98213]: LX May 27 20:58:37.132376 np0000001553 nova-compute[98213]: SPARCClassic May 27 20:58:37.132376 np0000001553 nova-compute[98213]: leon3_generic May 27 20:58:37.134465 np0000001553 nova-compute[98213]: SPARCbook May 27 20:58:37.134465 np0000001553 nova-compute[98213]: SS-4 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: SS-600MP May 27 20:58:37.134465 np0000001553 nova-compute[98213]: SS-10 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: Voyager May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-sparc64 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: sun4u May 27 20:58:37.134465 np0000001553 nova-compute[98213]: niagara May 27 20:58:37.134465 np0000001553 nova-compute[98213]: sun4v May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.134465 np0000001553 nova-compute[98213]: May 27 20:58:37.134465 np0000001553 nova-compute[98213]: 64 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-x86_64 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-noble-v2 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: ubuntu May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-q35-mantic May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-impish-hpb May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-q35-5.2 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-q35-lunar-hpb May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-mantic May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-2.12 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-2.0 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-xenial May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-q35-kinetic May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-6.2 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-q35-4.2 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-mantic-maxcpus May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-2.5 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-4.2 May 27 20:58:37.134465 np0000001553 nova-compute[98213]: pc-i440fx-focal May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-hirsute May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-xenial May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-jammy-hpb May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-5.2 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-2.7 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-eoan-hpb May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-zesty May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-groovy May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-disco-hpb May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-lunar May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-mantic-hpb-maxcpus May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-groovy May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-7.1 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-artful May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-trusty May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-2.2 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-focal-hpb May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-8.1 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-eoan-hpb May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-jammy-maxcpus May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-bionic-hpb May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-mantic-hpb May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-artful May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-8.1 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-2.7 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-6.1 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-kinetic May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-jammy-maxcpus May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-yakkety May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-2.4 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-cosmic-hpb May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-7.1 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-2.10 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: x-remote May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-5.1 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-q35-2.9 May 27 20:58:37.135544 np0000001553 nova-compute[98213]: pc-i440fx-2.11 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-jammy-hpb-maxcpus May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-3.1 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-6.1 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-4.1 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-jammy May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-2.4 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-4.1 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-eoan May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-jammy-hpb May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-5.1 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-2.9 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-bionic-hpb May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-lunar May 27 20:58:37.136132 np0000001553 nova-compute[98213]: isapc May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-mantic-hpb May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-cosmic May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-2.6 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-mantic-maxcpus May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-3.1 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-bionic May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-disco-hpb May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-cosmic May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-2.12 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-bionic May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-kinetic-hpb May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-groovy-hpb May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-7.0 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-noble-v2 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: ubuntu-q35 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-lunar-hpb May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-disco May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-cosmic-hpb May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-i440fx-2.1 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-noble May 27 20:58:37.136132 np0000001553 nova-compute[98213]: q35 May 27 20:58:37.136132 np0000001553 nova-compute[98213]: pc-q35-8.0 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-wily May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-impish May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-8.0 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-2.6 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-6.0 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-impish May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-jammy May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-impish-hpb May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-hirsute May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-4.0.1 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-hirsute-hpb May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-7.0 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-5.0 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-2.8 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-2.10 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-3.0 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-zesty May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-7.2 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-4.0 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-6.0 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-focal May 27 20:58:37.137824 np0000001553 nova-compute[98213]: microvm May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-2.3 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-jammy-hpb-maxcpus May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-disco May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-kinetic-hpb May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-4.0 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-focal-hpb May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-noble May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-q35-8.2 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: q35 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-groovy-hpb May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-hirsute-hpb May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc-i440fx-8.2 May 27 20:58:37.137824 np0000001553 nova-compute[98213]: pc May 27 20:58:37.138768 np0000001553 nova-compute[98213]: pc-i440fx-5.0 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: pc-i440fx-2.8 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: pc-q35-6.2 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: pc-i440fx-eoan May 27 20:58:37.138768 np0000001553 nova-compute[98213]: pc-q35-2.5 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: pc-i440fx-3.0 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: pc-q35-yakkety May 27 20:58:37.138768 np0000001553 nova-compute[98213]: pc-i440fx-mantic-hpb-maxcpus May 27 20:58:37.138768 np0000001553 nova-compute[98213]: pc-i440fx-7.2 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: pc-q35-2.11 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-xtensa May 27 20:58:37.138768 np0000001553 nova-compute[98213]: sim May 27 20:58:37.138768 np0000001553 nova-compute[98213]: kc705 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: ml605 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: ml605-nommu May 27 20:58:37.138768 np0000001553 nova-compute[98213]: virt May 27 20:58:37.138768 np0000001553 nova-compute[98213]: lx60-nommu May 27 20:58:37.138768 np0000001553 nova-compute[98213]: lx200 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: lx200-nommu May 27 20:58:37.138768 np0000001553 nova-compute[98213]: lx60 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: kc705-nommu May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: hvm May 27 20:58:37.138768 np0000001553 nova-compute[98213]: May 27 20:58:37.138768 np0000001553 nova-compute[98213]: 32 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-xtensaeb May 27 20:58:37.138768 np0000001553 nova-compute[98213]: sim May 27 20:58:37.138768 np0000001553 nova-compute[98213]: kc705 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: ml605 May 27 20:58:37.138768 np0000001553 nova-compute[98213]: ml605-nommu May 27 20:58:37.138768 np0000001553 nova-compute[98213]: virt May 27 20:58:37.139659 np0000001553 nova-compute[98213]: lx60-nommu May 27 20:58:37.139659 np0000001553 nova-compute[98213]: lx200 May 27 20:58:37.139659 np0000001553 nova-compute[98213]: lx200-nommu May 27 20:58:37.139659 np0000001553 nova-compute[98213]: lx60 May 27 20:58:37.139659 np0000001553 nova-compute[98213]: kc705-nommu May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.139659 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-alpha May 27 20:58:37.139659 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.139659 np0000001553 nova-compute[98213]: clipper May 27 20:58:37.139659 np0000001553 nova-compute[98213]: alpha May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.139659 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: rom May 27 20:58:37.139659 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: yes May 27 20:58:37.139659 np0000001553 nova-compute[98213]: no May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: no May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: file May 27 20:58:37.139659 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.139659 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: May 27 20:58:37.139659 np0000001553 nova-compute[98213]: disk May 27 20:58:37.142845 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.142845 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.142845 np0000001553 nova-compute[98213]: lun May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.142845 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.142845 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.142845 np0000001553 nova-compute[98213]: usb May 27 20:58:37.142845 np0000001553 nova-compute[98213]: sata May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.142845 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.142845 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.142845 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.142845 np0000001553 nova-compute[98213]: spice May 27 20:58:37.142845 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.142845 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: default May 27 20:58:37.142845 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.142845 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.142845 np0000001553 nova-compute[98213]: optional May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: usb May 27 20:58:37.142845 np0000001553 nova-compute[98213]: pci May 27 20:58:37.142845 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.142845 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.142845 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: random May 27 20:58:37.142845 np0000001553 nova-compute[98213]: egd May 27 20:58:37.142845 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: path May 27 20:58:37.142845 np0000001553 nova-compute[98213]: handle May 27 20:58:37.142845 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: usb May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.142845 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: pty May 27 20:58:37.145237 np0000001553 nova-compute[98213]: unix May 27 20:58:37.145237 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.145237 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.145237 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-arm May 27 20:58:37.145237 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.145237 np0000001553 nova-compute[98213]: virt-8.2 May 27 20:58:37.145237 np0000001553 nova-compute[98213]: armv6l May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.145237 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: rom May 27 20:58:37.145237 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: yes May 27 20:58:37.145237 np0000001553 nova-compute[98213]: no May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: no May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.145237 np0000001553 nova-compute[98213]: May 27 20:58:37.148491 np0000001553 nova-compute[98213]: May 27 20:58:37.148491 np0000001553 nova-compute[98213]: May 27 20:58:37.148491 np0000001553 nova-compute[98213]: on May 27 20:58:37.148491 np0000001553 nova-compute[98213]: off May 27 20:58:37.148491 np0000001553 nova-compute[98213]: May 27 20:58:37.148491 np0000001553 nova-compute[98213]: May 27 20:58:37.148491 np0000001553 nova-compute[98213]: May 27 20:58:37.148491 np0000001553 nova-compute[98213]: May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa270-c0 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-a15 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa270-b0 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-m4 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa270-a0 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: arm1176 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa270-b1 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-a7 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa270-a1 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-a8 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-r5 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: ti925t May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-r5f May 27 20:58:37.148491 np0000001553 nova-compute[98213]: arm1026 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-a9 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-m7 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa270 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa260 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa250 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa270-c5 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa261 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: pxa262 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: sa1110 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-r52 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: sa1100 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: max May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-m0 May 27 20:58:37.148491 np0000001553 nova-compute[98213]: cortex-m33 May 27 20:58:37.149426 np0000001553 nova-compute[98213]: arm946 May 27 20:58:37.149426 np0000001553 nova-compute[98213]: pxa255 May 27 20:58:37.149426 np0000001553 nova-compute[98213]: arm11mpcore May 27 20:58:37.149426 np0000001553 nova-compute[98213]: cortex-m55 May 27 20:58:37.149426 np0000001553 nova-compute[98213]: arm926 May 27 20:58:37.149426 np0000001553 nova-compute[98213]: arm1136 May 27 20:58:37.149426 np0000001553 nova-compute[98213]: arm1136-r2 May 27 20:58:37.149426 np0000001553 nova-compute[98213]: cortex-m3 May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: file May 27 20:58:37.149426 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.149426 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: disk May 27 20:58:37.149426 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.149426 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.149426 np0000001553 nova-compute[98213]: lun May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.149426 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.149426 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.149426 np0000001553 nova-compute[98213]: usb May 27 20:58:37.149426 np0000001553 nova-compute[98213]: sata May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.149426 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.149426 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.149426 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.149426 np0000001553 nova-compute[98213]: spice May 27 20:58:37.149426 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.149426 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.149426 np0000001553 nova-compute[98213]: default May 27 20:58:37.149426 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.149426 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.149426 np0000001553 nova-compute[98213]: optional May 27 20:58:37.149426 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: usb May 27 20:58:37.152386 np0000001553 nova-compute[98213]: pci May 27 20:58:37.152386 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.152386 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.152386 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: random May 27 20:58:37.152386 np0000001553 nova-compute[98213]: egd May 27 20:58:37.152386 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: path May 27 20:58:37.152386 np0000001553 nova-compute[98213]: handle May 27 20:58:37.152386 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.152386 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.152386 np0000001553 nova-compute[98213]: external May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.152386 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: usb May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: pty May 27 20:58:37.152386 np0000001553 nova-compute[98213]: unix May 27 20:58:37.152386 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: 2 May 27 20:58:37.152386 np0000001553 nova-compute[98213]: 3 May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.152386 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.155576 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-arm May 27 20:58:37.155576 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.155576 np0000001553 nova-compute[98213]: virt-8.2 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: armv6l May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.155576 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: rom May 27 20:58:37.155576 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: yes May 27 20:58:37.155576 np0000001553 nova-compute[98213]: no May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: no May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: on May 27 20:58:37.155576 np0000001553 nova-compute[98213]: off May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: May 27 20:58:37.155576 np0000001553 nova-compute[98213]: pxa270-c0 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: cortex-a15 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: pxa270-b0 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: cortex-m4 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: pxa270-a0 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: arm1176 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: pxa270-b1 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: cortex-a7 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: pxa270-a1 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: cortex-a8 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: cortex-r5 May 27 20:58:37.155576 np0000001553 nova-compute[98213]: ti925t May 27 20:58:37.156541 np0000001553 nova-compute[98213]: cortex-r5f May 27 20:58:37.156541 np0000001553 nova-compute[98213]: arm1026 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: cortex-a9 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: cortex-m7 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: pxa270 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: pxa260 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: pxa250 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: pxa270-c5 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: pxa261 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: pxa262 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: sa1110 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: cortex-r52 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: sa1100 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: max May 27 20:58:37.156541 np0000001553 nova-compute[98213]: cortex-m0 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: cortex-m33 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: arm946 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: pxa255 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: arm11mpcore May 27 20:58:37.156541 np0000001553 nova-compute[98213]: cortex-m55 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: arm926 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: arm1136 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: arm1136-r2 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: cortex-m3 May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: file May 27 20:58:37.156541 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.156541 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: disk May 27 20:58:37.156541 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.156541 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.156541 np0000001553 nova-compute[98213]: lun May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: May 27 20:58:37.156541 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.156541 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.156541 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.157368 np0000001553 nova-compute[98213]: usb May 27 20:58:37.157368 np0000001553 nova-compute[98213]: sata May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.157368 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.157368 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.157368 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.157368 np0000001553 nova-compute[98213]: spice May 27 20:58:37.157368 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.157368 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: default May 27 20:58:37.157368 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.157368 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.157368 np0000001553 nova-compute[98213]: optional May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: usb May 27 20:58:37.157368 np0000001553 nova-compute[98213]: pci May 27 20:58:37.157368 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.157368 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.157368 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: random May 27 20:58:37.157368 np0000001553 nova-compute[98213]: egd May 27 20:58:37.157368 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: path May 27 20:58:37.157368 np0000001553 nova-compute[98213]: handle May 27 20:58:37.157368 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.157368 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.157368 np0000001553 nova-compute[98213]: external May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: May 27 20:58:37.157368 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.158708 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: usb May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: pty May 27 20:58:37.158708 np0000001553 nova-compute[98213]: unix May 27 20:58:37.158708 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: 2 May 27 20:58:37.158708 np0000001553 nova-compute[98213]: 3 May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.158708 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.158708 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-arm May 27 20:58:37.158708 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.158708 np0000001553 nova-compute[98213]: virt-8.2 May 27 20:58:37.158708 np0000001553 nova-compute[98213]: armv7l May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: efi May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.158708 np0000001553 nova-compute[98213]: rom May 27 20:58:37.158708 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.158708 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: yes May 27 20:58:37.159960 np0000001553 nova-compute[98213]: no May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: no May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: on May 27 20:58:37.159960 np0000001553 nova-compute[98213]: off May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa270-c0 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: cortex-a15 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa270-b0 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: cortex-m4 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa270-a0 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: arm1176 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa270-b1 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: cortex-a7 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa270-a1 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: cortex-a8 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: cortex-r5 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: ti925t May 27 20:58:37.159960 np0000001553 nova-compute[98213]: cortex-r5f May 27 20:58:37.159960 np0000001553 nova-compute[98213]: arm1026 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: cortex-a9 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: cortex-m7 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa270 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa260 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa250 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa270-c5 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa261 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: pxa262 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: sa1110 May 27 20:58:37.159960 np0000001553 nova-compute[98213]: cortex-r52 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: sa1100 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: max May 27 20:58:37.161696 np0000001553 nova-compute[98213]: cortex-m0 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: cortex-m33 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: arm946 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: pxa255 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: arm11mpcore May 27 20:58:37.161696 np0000001553 nova-compute[98213]: cortex-m55 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: arm926 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: arm1136 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: arm1136-r2 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: cortex-m3 May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: file May 27 20:58:37.161696 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.161696 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: disk May 27 20:58:37.161696 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.161696 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.161696 np0000001553 nova-compute[98213]: lun May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.161696 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.161696 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.161696 np0000001553 nova-compute[98213]: usb May 27 20:58:37.161696 np0000001553 nova-compute[98213]: sata May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.161696 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.161696 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.161696 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.161696 np0000001553 nova-compute[98213]: spice May 27 20:58:37.161696 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.161696 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.161696 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: default May 27 20:58:37.162753 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.162753 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.162753 np0000001553 nova-compute[98213]: optional May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: usb May 27 20:58:37.162753 np0000001553 nova-compute[98213]: pci May 27 20:58:37.162753 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.162753 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.162753 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: random May 27 20:58:37.162753 np0000001553 nova-compute[98213]: egd May 27 20:58:37.162753 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: path May 27 20:58:37.162753 np0000001553 nova-compute[98213]: handle May 27 20:58:37.162753 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.162753 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.162753 np0000001553 nova-compute[98213]: external May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.162753 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: usb May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: pty May 27 20:58:37.162753 np0000001553 nova-compute[98213]: unix May 27 20:58:37.162753 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: 2 May 27 20:58:37.162753 np0000001553 nova-compute[98213]: 3 May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.162753 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.164017 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.164017 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-aarch64 May 27 20:58:37.164017 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.164017 np0000001553 nova-compute[98213]: virt-8.2 May 27 20:58:37.164017 np0000001553 nova-compute[98213]: aarch64 May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: efi May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.ms.fd May 27 20:58:37.164017 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.secboot.fd May 27 20:58:37.164017 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.no-secboot.fd May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: rom May 27 20:58:37.164017 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: yes May 27 20:58:37.164017 np0000001553 nova-compute[98213]: no May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: no May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: on May 27 20:58:37.164017 np0000001553 nova-compute[98213]: off May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: May 27 20:58:37.164017 np0000001553 nova-compute[98213]: neoverse-n2 May 27 20:58:37.164017 np0000001553 nova-compute[98213]: pxa270-c0 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-a15 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: pxa270-b0 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-a57 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-m4 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: pxa270-a0 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: arm1176 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: pxa270-b1 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-a7 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: pxa270-a1 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-a76 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: a64fx May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-a8 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: neoverse-v1 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-r5 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: ti925t May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-r5f May 27 20:58:37.164967 np0000001553 nova-compute[98213]: arm1026 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-a9 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-m7 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: pxa270 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: pxa260 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: pxa250 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: pxa270-c5 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: pxa261 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: pxa262 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-a710 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: sa1110 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-r52 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: sa1100 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: max May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-a53 May 27 20:58:37.164967 np0000001553 nova-compute[98213]: cortex-m0 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: cortex-m33 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: cortex-a72 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: arm946 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: pxa255 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: cortex-a55 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: arm11mpcore May 27 20:58:37.165546 np0000001553 nova-compute[98213]: cortex-m55 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: neoverse-n1 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: arm926 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: arm1136 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: cortex-a35 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: arm1136-r2 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: cortex-m3 May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: file May 27 20:58:37.165546 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.165546 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: disk May 27 20:58:37.165546 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.165546 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.165546 np0000001553 nova-compute[98213]: lun May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.165546 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.165546 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.165546 np0000001553 nova-compute[98213]: usb May 27 20:58:37.165546 np0000001553 nova-compute[98213]: sata May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.165546 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.165546 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.165546 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.165546 np0000001553 nova-compute[98213]: spice May 27 20:58:37.165546 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.165546 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.165546 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: default May 27 20:58:37.166465 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.166465 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.166465 np0000001553 nova-compute[98213]: optional May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: usb May 27 20:58:37.166465 np0000001553 nova-compute[98213]: pci May 27 20:58:37.166465 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.166465 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.166465 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: random May 27 20:58:37.166465 np0000001553 nova-compute[98213]: egd May 27 20:58:37.166465 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: path May 27 20:58:37.166465 np0000001553 nova-compute[98213]: handle May 27 20:58:37.166465 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.166465 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.166465 np0000001553 nova-compute[98213]: external May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.166465 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: usb May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: pty May 27 20:58:37.166465 np0000001553 nova-compute[98213]: unix May 27 20:58:37.166465 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: May 27 20:58:37.166465 np0000001553 nova-compute[98213]: 2 May 27 20:58:37.167766 np0000001553 nova-compute[98213]: 3 May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.167766 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.167766 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-cris May 27 20:58:37.167766 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.167766 np0000001553 nova-compute[98213]: axis-dev88 May 27 20:58:37.167766 np0000001553 nova-compute[98213]: cris May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.167766 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: rom May 27 20:58:37.167766 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: yes May 27 20:58:37.167766 np0000001553 nova-compute[98213]: no May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: no May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: file May 27 20:58:37.167766 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.167766 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: May 27 20:58:37.167766 np0000001553 nova-compute[98213]: disk May 27 20:58:37.167766 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.168884 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.168884 np0000001553 nova-compute[98213]: lun May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.168884 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.168884 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.168884 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.168884 np0000001553 nova-compute[98213]: spice May 27 20:58:37.168884 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.168884 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: default May 27 20:58:37.168884 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.168884 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.168884 np0000001553 nova-compute[98213]: optional May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: pci May 27 20:58:37.168884 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: random May 27 20:58:37.168884 np0000001553 nova-compute[98213]: egd May 27 20:58:37.168884 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: path May 27 20:58:37.168884 np0000001553 nova-compute[98213]: handle May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: pty May 27 20:58:37.168884 np0000001553 nova-compute[98213]: unix May 27 20:58:37.168884 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.168884 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.170229 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.170229 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-i386 May 27 20:58:37.170229 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.170229 np0000001553 nova-compute[98213]: pc-q35-noble May 27 20:58:37.170229 np0000001553 nova-compute[98213]: i686 May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.170229 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: rom May 27 20:58:37.170229 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: yes May 27 20:58:37.170229 np0000001553 nova-compute[98213]: no May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: no May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: on May 27 20:58:37.170229 np0000001553 nova-compute[98213]: off May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.170229 np0000001553 nova-compute[98213]: AMD May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.170229 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: May 27 20:58:37.171186 np0000001553 nova-compute[98213]: qemu64 May 27 20:58:37.171186 np0000001553 nova-compute[98213]: qemu32 May 27 20:58:37.171186 np0000001553 nova-compute[98213]: phenom May 27 20:58:37.171186 np0000001553 nova-compute[98213]: pentium3 May 27 20:58:37.171186 np0000001553 nova-compute[98213]: pentium2 May 27 20:58:37.171186 np0000001553 nova-compute[98213]: pentium May 27 20:58:37.171186 np0000001553 nova-compute[98213]: n270 May 27 20:58:37.171186 np0000001553 nova-compute[98213]: kvm64 May 27 20:58:37.171186 np0000001553 nova-compute[98213]: kvm32 May 27 20:58:37.171186 np0000001553 nova-compute[98213]: coreduo May 27 20:58:37.171186 np0000001553 nova-compute[98213]: core2duo May 27 20:58:37.171186 np0000001553 nova-compute[98213]: athlon May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Westmere-IBRS May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Westmere May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Snowridge May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Skylake-Server-noTSX-IBRS May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Skylake-Server-IBRS May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Skylake-Server May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Skylake-Client-noTSX-IBRS May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Skylake-Client-IBRS May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Skylake-Client May 27 20:58:37.171964 np0000001553 nova-compute[98213]: SapphireRapids May 27 20:58:37.171964 np0000001553 nova-compute[98213]: SandyBridge-IBRS May 27 20:58:37.171964 np0000001553 nova-compute[98213]: SandyBridge May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Penryn May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Opteron_G5 May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Opteron_G4 May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Opteron_G3 May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Opteron_G2 May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Opteron_G1 May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Nehalem-IBRS May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Nehalem May 27 20:58:37.171964 np0000001553 nova-compute[98213]: IvyBridge-IBRS May 27 20:58:37.171964 np0000001553 nova-compute[98213]: IvyBridge May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Icelake-Server-noTSX May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Icelake-Server May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Haswell-noTSX-IBRS May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Haswell-noTSX May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Haswell-IBRS May 27 20:58:37.171964 np0000001553 nova-compute[98213]: Haswell May 27 20:58:37.171964 np0000001553 nova-compute[98213]: EPYC-Rome May 27 20:58:37.171964 np0000001553 nova-compute[98213]: EPYC-Milan May 27 20:58:37.171964 np0000001553 nova-compute[98213]: EPYC-IBPB May 27 20:58:37.171964 np0000001553 nova-compute[98213]: EPYC-Genoa May 27 20:58:37.171964 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.172659 np0000001553 nova-compute[98213]: Dhyana May 27 20:58:37.172659 np0000001553 nova-compute[98213]: Cooperlake May 27 20:58:37.172659 np0000001553 nova-compute[98213]: Conroe May 27 20:58:37.172659 np0000001553 nova-compute[98213]: Cascadelake-Server-noTSX May 27 20:58:37.172659 np0000001553 nova-compute[98213]: Cascadelake-Server May 27 20:58:37.172659 np0000001553 nova-compute[98213]: Broadwell-noTSX-IBRS May 27 20:58:37.172659 np0000001553 nova-compute[98213]: Broadwell-noTSX May 27 20:58:37.172659 np0000001553 nova-compute[98213]: Broadwell-IBRS May 27 20:58:37.172659 np0000001553 nova-compute[98213]: Broadwell May 27 20:58:37.172659 np0000001553 nova-compute[98213]: 486 May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: file May 27 20:58:37.172659 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.172659 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: disk May 27 20:58:37.172659 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.172659 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.172659 np0000001553 nova-compute[98213]: lun May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.172659 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.172659 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.172659 np0000001553 nova-compute[98213]: usb May 27 20:58:37.172659 np0000001553 nova-compute[98213]: sata May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.172659 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.172659 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.172659 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.172659 np0000001553 nova-compute[98213]: spice May 27 20:58:37.172659 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.172659 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.172659 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: default May 27 20:58:37.173861 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.173861 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.173861 np0000001553 nova-compute[98213]: optional May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: usb May 27 20:58:37.173861 np0000001553 nova-compute[98213]: pci May 27 20:58:37.173861 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.173861 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.173861 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: random May 27 20:58:37.173861 np0000001553 nova-compute[98213]: egd May 27 20:58:37.173861 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: path May 27 20:58:37.173861 np0000001553 nova-compute[98213]: handle May 27 20:58:37.173861 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.173861 np0000001553 nova-compute[98213]: tpm-crb May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.173861 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.173861 np0000001553 nova-compute[98213]: external May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.173861 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: usb May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: pty May 27 20:58:37.173861 np0000001553 nova-compute[98213]: unix May 27 20:58:37.173861 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.173861 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: relaxed May 27 20:58:37.175964 np0000001553 nova-compute[98213]: vapic May 27 20:58:37.175964 np0000001553 nova-compute[98213]: spinlocks May 27 20:58:37.175964 np0000001553 nova-compute[98213]: vpindex May 27 20:58:37.175964 np0000001553 nova-compute[98213]: runtime May 27 20:58:37.175964 np0000001553 nova-compute[98213]: synic May 27 20:58:37.175964 np0000001553 nova-compute[98213]: stimer May 27 20:58:37.175964 np0000001553 nova-compute[98213]: reset May 27 20:58:37.175964 np0000001553 nova-compute[98213]: vendor_id May 27 20:58:37.175964 np0000001553 nova-compute[98213]: frequencies May 27 20:58:37.175964 np0000001553 nova-compute[98213]: reenlightenment May 27 20:58:37.175964 np0000001553 nova-compute[98213]: tlbflush May 27 20:58:37.175964 np0000001553 nova-compute[98213]: ipi May 27 20:58:37.175964 np0000001553 nova-compute[98213]: avic May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.175964 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-i386 May 27 20:58:37.175964 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.175964 np0000001553 nova-compute[98213]: pc-q35-noble-v2 May 27 20:58:37.175964 np0000001553 nova-compute[98213]: i686 May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.175964 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: rom May 27 20:58:37.175964 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: yes May 27 20:58:37.175964 np0000001553 nova-compute[98213]: no May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: no May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: on May 27 20:58:37.175964 np0000001553 nova-compute[98213]: off May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.175964 np0000001553 nova-compute[98213]: AMD May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.175964 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: May 27 20:58:37.177104 np0000001553 nova-compute[98213]: qemu64 May 27 20:58:37.177104 np0000001553 nova-compute[98213]: qemu32 May 27 20:58:37.177104 np0000001553 nova-compute[98213]: phenom May 27 20:58:37.177104 np0000001553 nova-compute[98213]: pentium3 May 27 20:58:37.177104 np0000001553 nova-compute[98213]: pentium2 May 27 20:58:37.177104 np0000001553 nova-compute[98213]: pentium May 27 20:58:37.177104 np0000001553 nova-compute[98213]: n270 May 27 20:58:37.177104 np0000001553 nova-compute[98213]: kvm64 May 27 20:58:37.177104 np0000001553 nova-compute[98213]: kvm32 May 27 20:58:37.177104 np0000001553 nova-compute[98213]: coreduo May 27 20:58:37.177814 np0000001553 nova-compute[98213]: core2duo May 27 20:58:37.177814 np0000001553 nova-compute[98213]: athlon May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Westmere-IBRS May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Westmere May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Snowridge May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Skylake-Server-noTSX-IBRS May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Skylake-Server-IBRS May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Skylake-Server May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Skylake-Client-noTSX-IBRS May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Skylake-Client-IBRS May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Skylake-Client May 27 20:58:37.177814 np0000001553 nova-compute[98213]: SapphireRapids May 27 20:58:37.177814 np0000001553 nova-compute[98213]: SandyBridge-IBRS May 27 20:58:37.177814 np0000001553 nova-compute[98213]: SandyBridge May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Penryn May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Opteron_G5 May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Opteron_G4 May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Opteron_G3 May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Opteron_G2 May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Opteron_G1 May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Nehalem-IBRS May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Nehalem May 27 20:58:37.177814 np0000001553 nova-compute[98213]: IvyBridge-IBRS May 27 20:58:37.177814 np0000001553 nova-compute[98213]: IvyBridge May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Icelake-Server-noTSX May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Icelake-Server May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Haswell-noTSX-IBRS May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Haswell-noTSX May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Haswell-IBRS May 27 20:58:37.177814 np0000001553 nova-compute[98213]: Haswell May 27 20:58:37.177814 np0000001553 nova-compute[98213]: EPYC-Rome May 27 20:58:37.177814 np0000001553 nova-compute[98213]: EPYC-Milan May 27 20:58:37.177814 np0000001553 nova-compute[98213]: EPYC-IBPB May 27 20:58:37.178370 np0000001553 nova-compute[98213]: EPYC-Genoa May 27 20:58:37.178370 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.178370 np0000001553 nova-compute[98213]: Dhyana May 27 20:58:37.178370 np0000001553 nova-compute[98213]: Cooperlake May 27 20:58:37.178370 np0000001553 nova-compute[98213]: Conroe May 27 20:58:37.178370 np0000001553 nova-compute[98213]: Cascadelake-Server-noTSX May 27 20:58:37.178370 np0000001553 nova-compute[98213]: Cascadelake-Server May 27 20:58:37.178370 np0000001553 nova-compute[98213]: Broadwell-noTSX-IBRS May 27 20:58:37.178370 np0000001553 nova-compute[98213]: Broadwell-noTSX May 27 20:58:37.178370 np0000001553 nova-compute[98213]: Broadwell-IBRS May 27 20:58:37.178370 np0000001553 nova-compute[98213]: Broadwell May 27 20:58:37.178370 np0000001553 nova-compute[98213]: 486 May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: file May 27 20:58:37.178370 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.178370 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: disk May 27 20:58:37.178370 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.178370 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.178370 np0000001553 nova-compute[98213]: lun May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.178370 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.178370 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.178370 np0000001553 nova-compute[98213]: usb May 27 20:58:37.178370 np0000001553 nova-compute[98213]: sata May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.178370 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.178370 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.178370 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.178370 np0000001553 nova-compute[98213]: spice May 27 20:58:37.178370 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.178370 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.178370 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: default May 27 20:58:37.179375 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.179375 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.179375 np0000001553 nova-compute[98213]: optional May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: usb May 27 20:58:37.179375 np0000001553 nova-compute[98213]: pci May 27 20:58:37.179375 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.179375 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.179375 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: random May 27 20:58:37.179375 np0000001553 nova-compute[98213]: egd May 27 20:58:37.179375 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: path May 27 20:58:37.179375 np0000001553 nova-compute[98213]: handle May 27 20:58:37.179375 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.179375 np0000001553 nova-compute[98213]: tpm-crb May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.179375 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.179375 np0000001553 nova-compute[98213]: external May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.179375 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: usb May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: pty May 27 20:58:37.179375 np0000001553 nova-compute[98213]: unix May 27 20:58:37.179375 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.179375 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: relaxed May 27 20:58:37.180886 np0000001553 nova-compute[98213]: vapic May 27 20:58:37.180886 np0000001553 nova-compute[98213]: spinlocks May 27 20:58:37.180886 np0000001553 nova-compute[98213]: vpindex May 27 20:58:37.180886 np0000001553 nova-compute[98213]: runtime May 27 20:58:37.180886 np0000001553 nova-compute[98213]: synic May 27 20:58:37.180886 np0000001553 nova-compute[98213]: stimer May 27 20:58:37.180886 np0000001553 nova-compute[98213]: reset May 27 20:58:37.180886 np0000001553 nova-compute[98213]: vendor_id May 27 20:58:37.180886 np0000001553 nova-compute[98213]: frequencies May 27 20:58:37.180886 np0000001553 nova-compute[98213]: reenlightenment May 27 20:58:37.180886 np0000001553 nova-compute[98213]: tlbflush May 27 20:58:37.180886 np0000001553 nova-compute[98213]: ipi May 27 20:58:37.180886 np0000001553 nova-compute[98213]: avic May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.180886 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-i386 May 27 20:58:37.180886 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.180886 np0000001553 nova-compute[98213]: pc-i440fx-noble-v2 May 27 20:58:37.180886 np0000001553 nova-compute[98213]: i686 May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.180886 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: rom May 27 20:58:37.180886 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: yes May 27 20:58:37.180886 np0000001553 nova-compute[98213]: no May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: no May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: on May 27 20:58:37.180886 np0000001553 nova-compute[98213]: off May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: May 27 20:58:37.180886 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.180886 np0000001553 nova-compute[98213]: AMD May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: May 27 20:58:37.182043 np0000001553 nova-compute[98213]: qemu64 May 27 20:58:37.182043 np0000001553 nova-compute[98213]: qemu32 May 27 20:58:37.182043 np0000001553 nova-compute[98213]: phenom May 27 20:58:37.182043 np0000001553 nova-compute[98213]: pentium3 May 27 20:58:37.182043 np0000001553 nova-compute[98213]: pentium2 May 27 20:58:37.182043 np0000001553 nova-compute[98213]: pentium May 27 20:58:37.182043 np0000001553 nova-compute[98213]: n270 May 27 20:58:37.183073 np0000001553 nova-compute[98213]: kvm64 May 27 20:58:37.183073 np0000001553 nova-compute[98213]: kvm32 May 27 20:58:37.183073 np0000001553 nova-compute[98213]: coreduo May 27 20:58:37.183073 np0000001553 nova-compute[98213]: core2duo May 27 20:58:37.183073 np0000001553 nova-compute[98213]: athlon May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Westmere-IBRS May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Westmere May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Snowridge May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Skylake-Server-noTSX-IBRS May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Skylake-Server-IBRS May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Skylake-Server May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Skylake-Client-noTSX-IBRS May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Skylake-Client-IBRS May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Skylake-Client May 27 20:58:37.183073 np0000001553 nova-compute[98213]: SapphireRapids May 27 20:58:37.183073 np0000001553 nova-compute[98213]: SandyBridge-IBRS May 27 20:58:37.183073 np0000001553 nova-compute[98213]: SandyBridge May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Penryn May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Opteron_G5 May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Opteron_G4 May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Opteron_G3 May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Opteron_G2 May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Opteron_G1 May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Nehalem-IBRS May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Nehalem May 27 20:58:37.183073 np0000001553 nova-compute[98213]: IvyBridge-IBRS May 27 20:58:37.183073 np0000001553 nova-compute[98213]: IvyBridge May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Icelake-Server-noTSX May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Icelake-Server May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Haswell-noTSX-IBRS May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Haswell-noTSX May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Haswell-IBRS May 27 20:58:37.183073 np0000001553 nova-compute[98213]: Haswell May 27 20:58:37.183719 np0000001553 nova-compute[98213]: EPYC-Rome May 27 20:58:37.183719 np0000001553 nova-compute[98213]: EPYC-Milan May 27 20:58:37.183719 np0000001553 nova-compute[98213]: EPYC-IBPB May 27 20:58:37.183719 np0000001553 nova-compute[98213]: EPYC-Genoa May 27 20:58:37.183719 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.183719 np0000001553 nova-compute[98213]: Dhyana May 27 20:58:37.183719 np0000001553 nova-compute[98213]: Cooperlake May 27 20:58:37.183719 np0000001553 nova-compute[98213]: Conroe May 27 20:58:37.183719 np0000001553 nova-compute[98213]: Cascadelake-Server-noTSX May 27 20:58:37.183719 np0000001553 nova-compute[98213]: Cascadelake-Server May 27 20:58:37.183719 np0000001553 nova-compute[98213]: Broadwell-noTSX-IBRS May 27 20:58:37.183719 np0000001553 nova-compute[98213]: Broadwell-noTSX May 27 20:58:37.183719 np0000001553 nova-compute[98213]: Broadwell-IBRS May 27 20:58:37.183719 np0000001553 nova-compute[98213]: Broadwell May 27 20:58:37.183719 np0000001553 nova-compute[98213]: 486 May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: file May 27 20:58:37.183719 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.183719 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: disk May 27 20:58:37.183719 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.183719 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.183719 np0000001553 nova-compute[98213]: lun May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: ide May 27 20:58:37.183719 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.183719 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.183719 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.183719 np0000001553 nova-compute[98213]: usb May 27 20:58:37.183719 np0000001553 nova-compute[98213]: sata May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.183719 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.183719 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.183719 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.183719 np0000001553 nova-compute[98213]: spice May 27 20:58:37.183719 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.183719 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.183719 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: default May 27 20:58:37.184942 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.184942 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.184942 np0000001553 nova-compute[98213]: optional May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: usb May 27 20:58:37.184942 np0000001553 nova-compute[98213]: pci May 27 20:58:37.184942 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.184942 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.184942 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: random May 27 20:58:37.184942 np0000001553 nova-compute[98213]: egd May 27 20:58:37.184942 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: path May 27 20:58:37.184942 np0000001553 nova-compute[98213]: handle May 27 20:58:37.184942 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.184942 np0000001553 nova-compute[98213]: tpm-crb May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.184942 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.184942 np0000001553 nova-compute[98213]: external May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.184942 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: usb May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: pty May 27 20:58:37.184942 np0000001553 nova-compute[98213]: unix May 27 20:58:37.184942 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.184942 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: relaxed May 27 20:58:37.186234 np0000001553 nova-compute[98213]: vapic May 27 20:58:37.186234 np0000001553 nova-compute[98213]: spinlocks May 27 20:58:37.186234 np0000001553 nova-compute[98213]: vpindex May 27 20:58:37.186234 np0000001553 nova-compute[98213]: runtime May 27 20:58:37.186234 np0000001553 nova-compute[98213]: synic May 27 20:58:37.186234 np0000001553 nova-compute[98213]: stimer May 27 20:58:37.186234 np0000001553 nova-compute[98213]: reset May 27 20:58:37.186234 np0000001553 nova-compute[98213]: vendor_id May 27 20:58:37.186234 np0000001553 nova-compute[98213]: frequencies May 27 20:58:37.186234 np0000001553 nova-compute[98213]: reenlightenment May 27 20:58:37.186234 np0000001553 nova-compute[98213]: tlbflush May 27 20:58:37.186234 np0000001553 nova-compute[98213]: ipi May 27 20:58:37.186234 np0000001553 nova-compute[98213]: avic May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.186234 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-i386 May 27 20:58:37.186234 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.186234 np0000001553 nova-compute[98213]: pc-i440fx-noble May 27 20:58:37.186234 np0000001553 nova-compute[98213]: i686 May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.186234 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: rom May 27 20:58:37.186234 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: yes May 27 20:58:37.186234 np0000001553 nova-compute[98213]: no May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: no May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.186234 np0000001553 nova-compute[98213]: on May 27 20:58:37.186234 np0000001553 nova-compute[98213]: off May 27 20:58:37.186234 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.188900 np0000001553 nova-compute[98213]: AMD May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: May 27 20:58:37.188900 np0000001553 nova-compute[98213]: qemu64 May 27 20:58:37.188900 np0000001553 nova-compute[98213]: qemu32 May 27 20:58:37.188900 np0000001553 nova-compute[98213]: phenom May 27 20:58:37.188900 np0000001553 nova-compute[98213]: pentium3 May 27 20:58:37.188900 np0000001553 nova-compute[98213]: pentium2 May 27 20:58:37.190116 np0000001553 nova-compute[98213]: pentium May 27 20:58:37.190116 np0000001553 nova-compute[98213]: n270 May 27 20:58:37.190116 np0000001553 nova-compute[98213]: kvm64 May 27 20:58:37.190116 np0000001553 nova-compute[98213]: kvm32 May 27 20:58:37.190116 np0000001553 nova-compute[98213]: coreduo May 27 20:58:37.190116 np0000001553 nova-compute[98213]: core2duo May 27 20:58:37.190116 np0000001553 nova-compute[98213]: athlon May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Westmere-IBRS May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Westmere May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Snowridge May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Skylake-Server-noTSX-IBRS May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Skylake-Server-IBRS May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Skylake-Server May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Skylake-Client-noTSX-IBRS May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Skylake-Client-IBRS May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Skylake-Client May 27 20:58:37.190116 np0000001553 nova-compute[98213]: SapphireRapids May 27 20:58:37.190116 np0000001553 nova-compute[98213]: SandyBridge-IBRS May 27 20:58:37.190116 np0000001553 nova-compute[98213]: SandyBridge May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Penryn May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Opteron_G5 May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Opteron_G4 May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Opteron_G3 May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Opteron_G2 May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Opteron_G1 May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Nehalem-IBRS May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Nehalem May 27 20:58:37.190116 np0000001553 nova-compute[98213]: IvyBridge-IBRS May 27 20:58:37.190116 np0000001553 nova-compute[98213]: IvyBridge May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Icelake-Server-noTSX May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Icelake-Server May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Haswell-noTSX-IBRS May 27 20:58:37.190116 np0000001553 nova-compute[98213]: Haswell-noTSX May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Haswell-IBRS May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Haswell May 27 20:58:37.190842 np0000001553 nova-compute[98213]: EPYC-Rome May 27 20:58:37.190842 np0000001553 nova-compute[98213]: EPYC-Milan May 27 20:58:37.190842 np0000001553 nova-compute[98213]: EPYC-IBPB May 27 20:58:37.190842 np0000001553 nova-compute[98213]: EPYC-Genoa May 27 20:58:37.190842 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Dhyana May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Cooperlake May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Conroe May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Cascadelake-Server-noTSX May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Cascadelake-Server May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Broadwell-noTSX-IBRS May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Broadwell-noTSX May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Broadwell-IBRS May 27 20:58:37.190842 np0000001553 nova-compute[98213]: Broadwell May 27 20:58:37.190842 np0000001553 nova-compute[98213]: 486 May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: file May 27 20:58:37.190842 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.190842 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: disk May 27 20:58:37.190842 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.190842 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.190842 np0000001553 nova-compute[98213]: lun May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: ide May 27 20:58:37.190842 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.190842 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.190842 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.190842 np0000001553 nova-compute[98213]: usb May 27 20:58:37.190842 np0000001553 nova-compute[98213]: sata May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.190842 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.190842 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.190842 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.190842 np0000001553 nova-compute[98213]: spice May 27 20:58:37.190842 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.190842 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.190842 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: default May 27 20:58:37.192008 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.192008 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.192008 np0000001553 nova-compute[98213]: optional May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: usb May 27 20:58:37.192008 np0000001553 nova-compute[98213]: pci May 27 20:58:37.192008 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.192008 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.192008 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: random May 27 20:58:37.192008 np0000001553 nova-compute[98213]: egd May 27 20:58:37.192008 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: path May 27 20:58:37.192008 np0000001553 nova-compute[98213]: handle May 27 20:58:37.192008 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.192008 np0000001553 nova-compute[98213]: tpm-crb May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.192008 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.192008 np0000001553 nova-compute[98213]: external May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.192008 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: usb May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: pty May 27 20:58:37.192008 np0000001553 nova-compute[98213]: unix May 27 20:58:37.192008 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: May 27 20:58:37.192008 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: relaxed May 27 20:58:37.193516 np0000001553 nova-compute[98213]: vapic May 27 20:58:37.193516 np0000001553 nova-compute[98213]: spinlocks May 27 20:58:37.193516 np0000001553 nova-compute[98213]: vpindex May 27 20:58:37.193516 np0000001553 nova-compute[98213]: runtime May 27 20:58:37.193516 np0000001553 nova-compute[98213]: synic May 27 20:58:37.193516 np0000001553 nova-compute[98213]: stimer May 27 20:58:37.193516 np0000001553 nova-compute[98213]: reset May 27 20:58:37.193516 np0000001553 nova-compute[98213]: vendor_id May 27 20:58:37.193516 np0000001553 nova-compute[98213]: frequencies May 27 20:58:37.193516 np0000001553 nova-compute[98213]: reenlightenment May 27 20:58:37.193516 np0000001553 nova-compute[98213]: tlbflush May 27 20:58:37.193516 np0000001553 nova-compute[98213]: ipi May 27 20:58:37.193516 np0000001553 nova-compute[98213]: avic May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.193516 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.193516 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-m68k May 27 20:58:37.193516 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.193516 np0000001553 nova-compute[98213]: mcf5208evb May 27 20:58:37.193516 np0000001553 nova-compute[98213]: m68k May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.193516 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.193516 np0000001553 nova-compute[98213]: rom May 27 20:58:37.193516 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.193516 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: yes May 27 20:58:37.194518 np0000001553 nova-compute[98213]: no May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: no May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: file May 27 20:58:37.194518 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.194518 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: disk May 27 20:58:37.194518 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.194518 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.194518 np0000001553 nova-compute[98213]: lun May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.194518 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.194518 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.194518 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.194518 np0000001553 nova-compute[98213]: spice May 27 20:58:37.194518 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.194518 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: default May 27 20:58:37.194518 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.194518 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.194518 np0000001553 nova-compute[98213]: optional May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: pci May 27 20:58:37.194518 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: random May 27 20:58:37.194518 np0000001553 nova-compute[98213]: egd May 27 20:58:37.194518 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.194518 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: path May 27 20:58:37.196267 np0000001553 nova-compute[98213]: handle May 27 20:58:37.196267 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: pty May 27 20:58:37.196267 np0000001553 nova-compute[98213]: unix May 27 20:58:37.196267 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.196267 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-m68k May 27 20:58:37.196267 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.196267 np0000001553 nova-compute[98213]: virt-8.2 May 27 20:58:37.196267 np0000001553 nova-compute[98213]: m68k May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.196267 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: rom May 27 20:58:37.196267 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: yes May 27 20:58:37.196267 np0000001553 nova-compute[98213]: no May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: no May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.196267 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: file May 27 20:58:37.198118 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.198118 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: disk May 27 20:58:37.198118 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.198118 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.198118 np0000001553 nova-compute[98213]: lun May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.198118 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.198118 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.198118 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.198118 np0000001553 nova-compute[98213]: spice May 27 20:58:37.198118 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.198118 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: default May 27 20:58:37.198118 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.198118 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.198118 np0000001553 nova-compute[98213]: optional May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: pci May 27 20:58:37.198118 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: random May 27 20:58:37.198118 np0000001553 nova-compute[98213]: egd May 27 20:58:37.198118 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: path May 27 20:58:37.198118 np0000001553 nova-compute[98213]: handle May 27 20:58:37.198118 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.198118 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: pty May 27 20:58:37.199550 np0000001553 nova-compute[98213]: unix May 27 20:58:37.199550 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.199550 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.199550 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-microblaze May 27 20:58:37.199550 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.199550 np0000001553 nova-compute[98213]: petalogix-s3adsp1800 May 27 20:58:37.199550 np0000001553 nova-compute[98213]: microblaze May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.199550 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: rom May 27 20:58:37.199550 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: yes May 27 20:58:37.199550 np0000001553 nova-compute[98213]: no May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: no May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.199550 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: file May 27 20:58:37.200579 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.200579 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: disk May 27 20:58:37.200579 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.200579 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.200579 np0000001553 nova-compute[98213]: lun May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.200579 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.200579 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.200579 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.200579 np0000001553 nova-compute[98213]: spice May 27 20:58:37.200579 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.200579 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: default May 27 20:58:37.200579 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.200579 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.200579 np0000001553 nova-compute[98213]: optional May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: pci May 27 20:58:37.200579 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: random May 27 20:58:37.200579 np0000001553 nova-compute[98213]: egd May 27 20:58:37.200579 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: path May 27 20:58:37.200579 np0000001553 nova-compute[98213]: handle May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.200579 np0000001553 nova-compute[98213]: pty May 27 20:58:37.200579 np0000001553 nova-compute[98213]: unix May 27 20:58:37.200579 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.200579 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.202518 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.202518 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-microblazeel May 27 20:58:37.202518 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.202518 np0000001553 nova-compute[98213]: petalogix-s3adsp1800 May 27 20:58:37.202518 np0000001553 nova-compute[98213]: microblazeel May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.202518 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: rom May 27 20:58:37.202518 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: yes May 27 20:58:37.202518 np0000001553 nova-compute[98213]: no May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: no May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.202518 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: file May 27 20:58:37.204263 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.204263 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: disk May 27 20:58:37.204263 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.204263 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.204263 np0000001553 nova-compute[98213]: lun May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.204263 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.204263 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.204263 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.204263 np0000001553 nova-compute[98213]: spice May 27 20:58:37.204263 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.204263 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: default May 27 20:58:37.204263 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.204263 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.204263 np0000001553 nova-compute[98213]: optional May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: pci May 27 20:58:37.204263 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: random May 27 20:58:37.204263 np0000001553 nova-compute[98213]: egd May 27 20:58:37.204263 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: path May 27 20:58:37.204263 np0000001553 nova-compute[98213]: handle May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: pty May 27 20:58:37.204263 np0000001553 nova-compute[98213]: unix May 27 20:58:37.204263 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.204263 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.204263 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.205963 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.205963 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-mips May 27 20:58:37.205963 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.205963 np0000001553 nova-compute[98213]: malta May 27 20:58:37.205963 np0000001553 nova-compute[98213]: mips May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.205963 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: rom May 27 20:58:37.205963 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: yes May 27 20:58:37.205963 np0000001553 nova-compute[98213]: no May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: no May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: file May 27 20:58:37.205963 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.205963 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.205963 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: disk May 27 20:58:37.207619 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.207619 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.207619 np0000001553 nova-compute[98213]: lun May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: ide May 27 20:58:37.207619 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.207619 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.207619 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.207619 np0000001553 nova-compute[98213]: usb May 27 20:58:37.207619 np0000001553 nova-compute[98213]: sata May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.207619 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.207619 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.207619 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.207619 np0000001553 nova-compute[98213]: spice May 27 20:58:37.207619 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.207619 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: default May 27 20:58:37.207619 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.207619 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.207619 np0000001553 nova-compute[98213]: optional May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: usb May 27 20:58:37.207619 np0000001553 nova-compute[98213]: pci May 27 20:58:37.207619 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.207619 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.207619 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: random May 27 20:58:37.207619 np0000001553 nova-compute[98213]: egd May 27 20:58:37.207619 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: path May 27 20:58:37.207619 np0000001553 nova-compute[98213]: handle May 27 20:58:37.207619 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.207619 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: usb May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: pty May 27 20:58:37.208849 np0000001553 nova-compute[98213]: unix May 27 20:58:37.208849 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.208849 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.208849 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-mipsel May 27 20:58:37.208849 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.208849 np0000001553 nova-compute[98213]: malta May 27 20:58:37.208849 np0000001553 nova-compute[98213]: mipsel May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.208849 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: rom May 27 20:58:37.208849 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: yes May 27 20:58:37.208849 np0000001553 nova-compute[98213]: no May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.208849 np0000001553 nova-compute[98213]: no May 27 20:58:37.208849 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: file May 27 20:58:37.209819 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.209819 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: disk May 27 20:58:37.209819 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.209819 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.209819 np0000001553 nova-compute[98213]: lun May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: ide May 27 20:58:37.209819 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.209819 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.209819 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.209819 np0000001553 nova-compute[98213]: usb May 27 20:58:37.209819 np0000001553 nova-compute[98213]: sata May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.209819 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.209819 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.209819 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.209819 np0000001553 nova-compute[98213]: spice May 27 20:58:37.209819 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.209819 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: default May 27 20:58:37.209819 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.209819 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.209819 np0000001553 nova-compute[98213]: optional May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: usb May 27 20:58:37.209819 np0000001553 nova-compute[98213]: pci May 27 20:58:37.209819 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: May 27 20:58:37.209819 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.210968 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.210968 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: random May 27 20:58:37.210968 np0000001553 nova-compute[98213]: egd May 27 20:58:37.210968 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: path May 27 20:58:37.210968 np0000001553 nova-compute[98213]: handle May 27 20:58:37.210968 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: usb May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: pty May 27 20:58:37.210968 np0000001553 nova-compute[98213]: unix May 27 20:58:37.210968 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.210968 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.210968 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.210968 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-mips64 May 27 20:58:37.210968 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.210968 np0000001553 nova-compute[98213]: malta May 27 20:58:37.210968 np0000001553 nova-compute[98213]: mips64 May 27 20:58:37.210968 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.211935 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: rom May 27 20:58:37.211935 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: yes May 27 20:58:37.211935 np0000001553 nova-compute[98213]: no May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: no May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: file May 27 20:58:37.211935 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.211935 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: disk May 27 20:58:37.211935 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.211935 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.211935 np0000001553 nova-compute[98213]: lun May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: ide May 27 20:58:37.211935 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.211935 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.211935 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.211935 np0000001553 nova-compute[98213]: usb May 27 20:58:37.211935 np0000001553 nova-compute[98213]: sata May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.211935 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.211935 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.211935 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.211935 np0000001553 nova-compute[98213]: spice May 27 20:58:37.211935 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.211935 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.211935 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.211935 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: default May 27 20:58:37.213230 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.213230 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.213230 np0000001553 nova-compute[98213]: optional May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: usb May 27 20:58:37.213230 np0000001553 nova-compute[98213]: pci May 27 20:58:37.213230 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.213230 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.213230 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: random May 27 20:58:37.213230 np0000001553 nova-compute[98213]: egd May 27 20:58:37.213230 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: path May 27 20:58:37.213230 np0000001553 nova-compute[98213]: handle May 27 20:58:37.213230 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: usb May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: pty May 27 20:58:37.213230 np0000001553 nova-compute[98213]: unix May 27 20:58:37.213230 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: May 27 20:58:37.213230 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.214320 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.214320 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-mips64el May 27 20:58:37.214320 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.214320 np0000001553 nova-compute[98213]: malta May 27 20:58:37.214320 np0000001553 nova-compute[98213]: mips64el May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.214320 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: rom May 27 20:58:37.214320 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: yes May 27 20:58:37.214320 np0000001553 nova-compute[98213]: no May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: no May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: file May 27 20:58:37.214320 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.214320 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: disk May 27 20:58:37.214320 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.214320 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.214320 np0000001553 nova-compute[98213]: lun May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: ide May 27 20:58:37.214320 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.214320 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.214320 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.214320 np0000001553 nova-compute[98213]: usb May 27 20:58:37.214320 np0000001553 nova-compute[98213]: sata May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: May 27 20:58:37.214320 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.214320 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.214320 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.215242 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.215242 np0000001553 nova-compute[98213]: spice May 27 20:58:37.215242 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.215242 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: default May 27 20:58:37.215242 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.215242 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.215242 np0000001553 nova-compute[98213]: optional May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: usb May 27 20:58:37.215242 np0000001553 nova-compute[98213]: pci May 27 20:58:37.215242 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.215242 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.215242 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: random May 27 20:58:37.215242 np0000001553 nova-compute[98213]: egd May 27 20:58:37.215242 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: path May 27 20:58:37.215242 np0000001553 nova-compute[98213]: handle May 27 20:58:37.215242 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: usb May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: pty May 27 20:58:37.215242 np0000001553 nova-compute[98213]: unix May 27 20:58:37.215242 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.215242 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.216419 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.216419 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-ppc May 27 20:58:37.216419 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.216419 np0000001553 nova-compute[98213]: g3beige May 27 20:58:37.216419 np0000001553 nova-compute[98213]: ppc May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.216419 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: rom May 27 20:58:37.216419 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: yes May 27 20:58:37.216419 np0000001553 nova-compute[98213]: no May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: no May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: file May 27 20:58:37.216419 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.216419 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: May 27 20:58:37.216419 np0000001553 nova-compute[98213]: disk May 27 20:58:37.217332 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.217332 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.217332 np0000001553 nova-compute[98213]: lun May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: ide May 27 20:58:37.217332 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.217332 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.217332 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.217332 np0000001553 nova-compute[98213]: usb May 27 20:58:37.217332 np0000001553 nova-compute[98213]: sata May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.217332 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.217332 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.217332 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.217332 np0000001553 nova-compute[98213]: spice May 27 20:58:37.217332 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.217332 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: default May 27 20:58:37.217332 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.217332 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.217332 np0000001553 nova-compute[98213]: optional May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: usb May 27 20:58:37.217332 np0000001553 nova-compute[98213]: pci May 27 20:58:37.217332 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.217332 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.217332 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: random May 27 20:58:37.217332 np0000001553 nova-compute[98213]: egd May 27 20:58:37.217332 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: path May 27 20:58:37.217332 np0000001553 nova-compute[98213]: handle May 27 20:58:37.217332 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: May 27 20:58:37.217332 np0000001553 nova-compute[98213]: usb May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: pty May 27 20:58:37.218512 np0000001553 nova-compute[98213]: unix May 27 20:58:37.218512 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.218512 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.218512 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-ppc64 May 27 20:58:37.218512 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.218512 np0000001553 nova-compute[98213]: pseries-noble May 27 20:58:37.218512 np0000001553 nova-compute[98213]: ppc64 May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.218512 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: rom May 27 20:58:37.218512 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: yes May 27 20:58:37.218512 np0000001553 nova-compute[98213]: no May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: no May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.218512 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: POWER10 May 27 20:58:37.219485 np0000001553 nova-compute[98213]: POWER9 May 27 20:58:37.219485 np0000001553 nova-compute[98213]: POWER8 May 27 20:58:37.219485 np0000001553 nova-compute[98213]: POWER7 May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: file May 27 20:58:37.219485 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.219485 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: disk May 27 20:58:37.219485 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.219485 np0000001553 nova-compute[98213]: lun May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.219485 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.219485 np0000001553 nova-compute[98213]: usb May 27 20:58:37.219485 np0000001553 nova-compute[98213]: sata May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.219485 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.219485 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.219485 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.219485 np0000001553 nova-compute[98213]: spice May 27 20:58:37.219485 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.219485 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: default May 27 20:58:37.219485 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.219485 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.219485 np0000001553 nova-compute[98213]: optional May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: usb May 27 20:58:37.219485 np0000001553 nova-compute[98213]: pci May 27 20:58:37.219485 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.219485 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.220528 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.220528 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: random May 27 20:58:37.220528 np0000001553 nova-compute[98213]: egd May 27 20:58:37.220528 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: path May 27 20:58:37.220528 np0000001553 nova-compute[98213]: handle May 27 20:58:37.220528 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: tpm-spapr May 27 20:58:37.220528 np0000001553 nova-compute[98213]: spapr-tpm-proxy May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.220528 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.220528 np0000001553 nova-compute[98213]: external May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.220528 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: usb May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: pty May 27 20:58:37.220528 np0000001553 nova-compute[98213]: unix May 27 20:58:37.220528 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: May 27 20:58:37.220528 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.221561 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-ppc64 May 27 20:58:37.221561 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.221561 np0000001553 nova-compute[98213]: powernv9 May 27 20:58:37.221561 np0000001553 nova-compute[98213]: ppc64 May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.221561 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: rom May 27 20:58:37.221561 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: yes May 27 20:58:37.221561 np0000001553 nova-compute[98213]: no May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: no May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: POWER10 May 27 20:58:37.221561 np0000001553 nova-compute[98213]: POWER9 May 27 20:58:37.221561 np0000001553 nova-compute[98213]: POWER8 May 27 20:58:37.221561 np0000001553 nova-compute[98213]: POWER7 May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: file May 27 20:58:37.221561 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.221561 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: disk May 27 20:58:37.221561 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.221561 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.221561 np0000001553 nova-compute[98213]: lun May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.221561 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.221561 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.221561 np0000001553 nova-compute[98213]: usb May 27 20:58:37.221561 np0000001553 nova-compute[98213]: sata May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.221561 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.221561 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.221561 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.222565 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.222565 np0000001553 nova-compute[98213]: spice May 27 20:58:37.222565 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.222565 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: default May 27 20:58:37.222565 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.222565 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.222565 np0000001553 nova-compute[98213]: optional May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: usb May 27 20:58:37.222565 np0000001553 nova-compute[98213]: pci May 27 20:58:37.222565 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.222565 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.222565 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: random May 27 20:58:37.222565 np0000001553 nova-compute[98213]: egd May 27 20:58:37.222565 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: path May 27 20:58:37.222565 np0000001553 nova-compute[98213]: handle May 27 20:58:37.222565 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: tpm-spapr May 27 20:58:37.222565 np0000001553 nova-compute[98213]: spapr-tpm-proxy May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.222565 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.222565 np0000001553 nova-compute[98213]: external May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.222565 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: usb May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: May 27 20:58:37.222565 np0000001553 nova-compute[98213]: pty May 27 20:58:37.222565 np0000001553 nova-compute[98213]: unix May 27 20:58:37.223877 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.223877 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-ppc64 May 27 20:58:37.223877 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.223877 np0000001553 nova-compute[98213]: pseries-noble May 27 20:58:37.223877 np0000001553 nova-compute[98213]: ppc64 May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.223877 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: rom May 27 20:58:37.223877 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: yes May 27 20:58:37.223877 np0000001553 nova-compute[98213]: no May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: no May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: POWER10 May 27 20:58:37.223877 np0000001553 nova-compute[98213]: POWER9 May 27 20:58:37.223877 np0000001553 nova-compute[98213]: POWER8 May 27 20:58:37.223877 np0000001553 nova-compute[98213]: POWER7 May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.223877 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: file May 27 20:58:37.224861 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.224861 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: disk May 27 20:58:37.224861 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.224861 np0000001553 nova-compute[98213]: lun May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.224861 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.224861 np0000001553 nova-compute[98213]: usb May 27 20:58:37.224861 np0000001553 nova-compute[98213]: sata May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.224861 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.224861 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.224861 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.224861 np0000001553 nova-compute[98213]: spice May 27 20:58:37.224861 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.224861 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: default May 27 20:58:37.224861 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.224861 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.224861 np0000001553 nova-compute[98213]: optional May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: usb May 27 20:58:37.224861 np0000001553 nova-compute[98213]: pci May 27 20:58:37.224861 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.224861 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.224861 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: random May 27 20:58:37.224861 np0000001553 nova-compute[98213]: egd May 27 20:58:37.224861 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: May 27 20:58:37.224861 np0000001553 nova-compute[98213]: path May 27 20:58:37.226232 np0000001553 nova-compute[98213]: handle May 27 20:58:37.226232 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: tpm-spapr May 27 20:58:37.226232 np0000001553 nova-compute[98213]: spapr-tpm-proxy May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.226232 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.226232 np0000001553 nova-compute[98213]: external May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.226232 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: usb May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: pty May 27 20:58:37.226232 np0000001553 nova-compute[98213]: unix May 27 20:58:37.226232 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.226232 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.226232 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: May 27 20:58:37.226232 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-ppc64le May 27 20:58:37.226232 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.226232 np0000001553 nova-compute[98213]: powernv9 May 27 20:58:37.227264 np0000001553 nova-compute[98213]: ppc64le May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.227264 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: rom May 27 20:58:37.227264 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: yes May 27 20:58:37.227264 np0000001553 nova-compute[98213]: no May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: no May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: POWER10 May 27 20:58:37.227264 np0000001553 nova-compute[98213]: POWER9 May 27 20:58:37.227264 np0000001553 nova-compute[98213]: POWER8 May 27 20:58:37.227264 np0000001553 nova-compute[98213]: POWER7 May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: file May 27 20:58:37.227264 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.227264 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: disk May 27 20:58:37.227264 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.227264 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.227264 np0000001553 nova-compute[98213]: lun May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.227264 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.227264 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.227264 np0000001553 nova-compute[98213]: usb May 27 20:58:37.227264 np0000001553 nova-compute[98213]: sata May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.227264 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.227264 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.227264 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.227264 np0000001553 nova-compute[98213]: spice May 27 20:58:37.227264 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.227264 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.227264 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: default May 27 20:58:37.228413 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.228413 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.228413 np0000001553 nova-compute[98213]: optional May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: usb May 27 20:58:37.228413 np0000001553 nova-compute[98213]: pci May 27 20:58:37.228413 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.228413 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.228413 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: random May 27 20:58:37.228413 np0000001553 nova-compute[98213]: egd May 27 20:58:37.228413 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: path May 27 20:58:37.228413 np0000001553 nova-compute[98213]: handle May 27 20:58:37.228413 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: tpm-spapr May 27 20:58:37.228413 np0000001553 nova-compute[98213]: spapr-tpm-proxy May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.228413 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.228413 np0000001553 nova-compute[98213]: external May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.228413 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: usb May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: pty May 27 20:58:37.228413 np0000001553 nova-compute[98213]: unix May 27 20:58:37.228413 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.228413 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.229601 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-ppc64le May 27 20:58:37.229601 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.229601 np0000001553 nova-compute[98213]: pseries-noble May 27 20:58:37.229601 np0000001553 nova-compute[98213]: ppc64le May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.229601 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: rom May 27 20:58:37.229601 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: yes May 27 20:58:37.229601 np0000001553 nova-compute[98213]: no May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: no May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: POWER10 May 27 20:58:37.229601 np0000001553 nova-compute[98213]: POWER9 May 27 20:58:37.229601 np0000001553 nova-compute[98213]: POWER8 May 27 20:58:37.229601 np0000001553 nova-compute[98213]: POWER7 May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: file May 27 20:58:37.229601 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.229601 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: May 27 20:58:37.229601 np0000001553 nova-compute[98213]: disk May 27 20:58:37.230558 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.230558 np0000001553 nova-compute[98213]: lun May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.230558 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.230558 np0000001553 nova-compute[98213]: usb May 27 20:58:37.230558 np0000001553 nova-compute[98213]: sata May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.230558 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.230558 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.230558 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.230558 np0000001553 nova-compute[98213]: spice May 27 20:58:37.230558 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.230558 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: default May 27 20:58:37.230558 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.230558 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.230558 np0000001553 nova-compute[98213]: optional May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: usb May 27 20:58:37.230558 np0000001553 nova-compute[98213]: pci May 27 20:58:37.230558 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.230558 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.230558 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: random May 27 20:58:37.230558 np0000001553 nova-compute[98213]: egd May 27 20:58:37.230558 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: path May 27 20:58:37.230558 np0000001553 nova-compute[98213]: handle May 27 20:58:37.230558 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: tpm-spapr May 27 20:58:37.230558 np0000001553 nova-compute[98213]: spapr-tpm-proxy May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.230558 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.231834 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.231834 np0000001553 nova-compute[98213]: external May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.231834 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: usb May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: pty May 27 20:58:37.231834 np0000001553 nova-compute[98213]: unix May 27 20:58:37.231834 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.231834 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.231834 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-riscv32 May 27 20:58:37.231834 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.231834 np0000001553 nova-compute[98213]: virt May 27 20:58:37.231834 np0000001553 nova-compute[98213]: riscv32 May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.231834 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.231834 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.231834 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: rom May 27 20:58:37.233004 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: yes May 27 20:58:37.233004 np0000001553 nova-compute[98213]: no May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: no May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: on May 27 20:58:37.233004 np0000001553 nova-compute[98213]: off May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: file May 27 20:58:37.233004 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.233004 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: disk May 27 20:58:37.233004 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.233004 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.233004 np0000001553 nova-compute[98213]: lun May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.233004 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.233004 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.233004 np0000001553 nova-compute[98213]: usb May 27 20:58:37.233004 np0000001553 nova-compute[98213]: sata May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.233004 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.233004 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.233004 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.233004 np0000001553 nova-compute[98213]: spice May 27 20:58:37.233004 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.233004 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: May 27 20:58:37.233004 np0000001553 nova-compute[98213]: default May 27 20:58:37.233004 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.233004 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.233004 np0000001553 nova-compute[98213]: optional May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: usb May 27 20:58:37.234981 np0000001553 nova-compute[98213]: pci May 27 20:58:37.234981 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.234981 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.234981 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: random May 27 20:58:37.234981 np0000001553 nova-compute[98213]: egd May 27 20:58:37.234981 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: path May 27 20:58:37.234981 np0000001553 nova-compute[98213]: handle May 27 20:58:37.234981 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.234981 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.234981 np0000001553 nova-compute[98213]: external May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.234981 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: usb May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: pty May 27 20:58:37.234981 np0000001553 nova-compute[98213]: unix May 27 20:58:37.234981 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: May 27 20:58:37.234981 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.236961 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.236961 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-riscv64 May 27 20:58:37.236961 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.236961 np0000001553 nova-compute[98213]: virt May 27 20:58:37.236961 np0000001553 nova-compute[98213]: riscv64 May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.236961 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: rom May 27 20:58:37.236961 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: yes May 27 20:58:37.236961 np0000001553 nova-compute[98213]: no May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: no May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: on May 27 20:58:37.236961 np0000001553 nova-compute[98213]: off May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: rv64 May 27 20:58:37.236961 np0000001553 nova-compute[98213]: sifive-e51 May 27 20:58:37.236961 np0000001553 nova-compute[98213]: any May 27 20:58:37.236961 np0000001553 nova-compute[98213]: x-rv128 May 27 20:58:37.236961 np0000001553 nova-compute[98213]: shakti-c May 27 20:58:37.236961 np0000001553 nova-compute[98213]: max May 27 20:58:37.236961 np0000001553 nova-compute[98213]: thead-c906 May 27 20:58:37.236961 np0000001553 nova-compute[98213]: sifive-u54 May 27 20:58:37.236961 np0000001553 nova-compute[98213]: veyron-v1 May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.236961 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: file May 27 20:58:37.238025 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.238025 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: disk May 27 20:58:37.238025 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.238025 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.238025 np0000001553 nova-compute[98213]: lun May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.238025 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.238025 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.238025 np0000001553 nova-compute[98213]: usb May 27 20:58:37.238025 np0000001553 nova-compute[98213]: sata May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.238025 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.238025 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.238025 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.238025 np0000001553 nova-compute[98213]: spice May 27 20:58:37.238025 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.238025 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: default May 27 20:58:37.238025 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.238025 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.238025 np0000001553 nova-compute[98213]: optional May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: usb May 27 20:58:37.238025 np0000001553 nova-compute[98213]: pci May 27 20:58:37.238025 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.238025 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.238025 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: random May 27 20:58:37.238025 np0000001553 nova-compute[98213]: egd May 27 20:58:37.238025 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.238025 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: path May 27 20:58:37.239936 np0000001553 nova-compute[98213]: handle May 27 20:58:37.239936 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.239936 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.239936 np0000001553 nova-compute[98213]: external May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.239936 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: usb May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: pty May 27 20:58:37.239936 np0000001553 nova-compute[98213]: unix May 27 20:58:37.239936 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.239936 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.239936 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: May 27 20:58:37.239936 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-s390x May 27 20:58:37.239936 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.241560 np0000001553 nova-compute[98213]: s390-ccw-virtio-noble May 27 20:58:37.241560 np0000001553 nova-compute[98213]: s390x May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.241560 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: rom May 27 20:58:37.241560 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: yes May 27 20:58:37.241560 np0000001553 nova-compute[98213]: no May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: no May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: on May 27 20:58:37.241560 np0000001553 nova-compute[98213]: off May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z13 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z990.3 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z13-base May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z990.2 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z196.2-base May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z14 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z14.2-base May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z990.4 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z196 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z10BC.2-base May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z114-base May 27 20:58:37.241560 np0000001553 nova-compute[98213]: gen16b May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z890.3-base May 27 20:58:37.241560 np0000001553 nova-compute[98213]: gen16a May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z990.5 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z196.2 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: zEC12 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: zEC12.2 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z9EC.2 May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z9BC May 27 20:58:37.241560 np0000001553 nova-compute[98213]: z9EC.3-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z800-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z14ZR1-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z890 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z990.4-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z9EC.3 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z13.2 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z10BC.2 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: gen15a-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z14.2 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: zBC12-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: gen16a-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z900.3 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z196-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z990 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z14-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z900.2 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z800 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z10EC May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z14ZR1 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z900 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z10EC.2 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z10EC.2-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z900.2-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z900-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z10EC.3 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z990.5-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: max May 27 20:58:37.242752 np0000001553 nova-compute[98213]: gen15b May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z9BC.2-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: gen15a May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z990.2-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z10EC-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: gen16b-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z114 May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z9EC-base May 27 20:58:37.242752 np0000001553 nova-compute[98213]: z13s May 27 20:58:37.242752 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.243662 np0000001553 nova-compute[98213]: gen15b-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: zEC12-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z890.3 May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z10EC.3-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z890.2-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z890.2 May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z10BC-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: zEC12.2-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z890-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z9BC-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z10BC May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z9EC May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z9EC.2-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z13.2-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z900.3-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z990.3-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z13s-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: zBC12 May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z990-base May 27 20:58:37.243662 np0000001553 nova-compute[98213]: z9BC.2 May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: file May 27 20:58:37.243662 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.243662 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: disk May 27 20:58:37.243662 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.243662 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.243662 np0000001553 nova-compute[98213]: lun May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.243662 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.243662 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.243662 np0000001553 nova-compute[98213]: usb May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.243662 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.243662 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.243662 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.243662 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.243662 np0000001553 nova-compute[98213]: spice May 27 20:58:37.243662 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.243662 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.243662 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: default May 27 20:58:37.245293 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.245293 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.245293 np0000001553 nova-compute[98213]: optional May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: usb May 27 20:58:37.245293 np0000001553 nova-compute[98213]: pci May 27 20:58:37.245293 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.245293 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.245293 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: random May 27 20:58:37.245293 np0000001553 nova-compute[98213]: egd May 27 20:58:37.245293 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: path May 27 20:58:37.245293 np0000001553 nova-compute[98213]: handle May 27 20:58:37.245293 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: usb May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: pty May 27 20:58:37.245293 np0000001553 nova-compute[98213]: unix May 27 20:58:37.245293 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.245293 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.246814 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.246814 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-sh4 May 27 20:58:37.246814 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.246814 np0000001553 nova-compute[98213]: shix May 27 20:58:37.246814 np0000001553 nova-compute[98213]: sh4 May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.246814 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: rom May 27 20:58:37.246814 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: yes May 27 20:58:37.246814 np0000001553 nova-compute[98213]: no May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: no May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: file May 27 20:58:37.246814 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.246814 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: disk May 27 20:58:37.246814 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.246814 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.246814 np0000001553 nova-compute[98213]: lun May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.246814 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.246814 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.246814 np0000001553 nova-compute[98213]: usb May 27 20:58:37.246814 np0000001553 nova-compute[98213]: sata May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: May 27 20:58:37.246814 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.247800 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.247800 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.247800 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.247800 np0000001553 nova-compute[98213]: spice May 27 20:58:37.247800 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.247800 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: default May 27 20:58:37.247800 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.247800 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.247800 np0000001553 nova-compute[98213]: optional May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: usb May 27 20:58:37.247800 np0000001553 nova-compute[98213]: pci May 27 20:58:37.247800 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.247800 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.247800 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: random May 27 20:58:37.247800 np0000001553 nova-compute[98213]: egd May 27 20:58:37.247800 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: path May 27 20:58:37.247800 np0000001553 nova-compute[98213]: handle May 27 20:58:37.247800 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: usb May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: pty May 27 20:58:37.247800 np0000001553 nova-compute[98213]: unix May 27 20:58:37.247800 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.247800 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.247800 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.249388 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.249388 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-sh4eb May 27 20:58:37.249388 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.249388 np0000001553 nova-compute[98213]: shix May 27 20:58:37.249388 np0000001553 nova-compute[98213]: sh4eb May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.249388 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: rom May 27 20:58:37.249388 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: yes May 27 20:58:37.249388 np0000001553 nova-compute[98213]: no May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: no May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: file May 27 20:58:37.249388 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.249388 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.249388 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: disk May 27 20:58:37.250469 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.250469 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.250469 np0000001553 nova-compute[98213]: lun May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.250469 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.250469 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.250469 np0000001553 nova-compute[98213]: usb May 27 20:58:37.250469 np0000001553 nova-compute[98213]: sata May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.250469 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.250469 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.250469 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.250469 np0000001553 nova-compute[98213]: spice May 27 20:58:37.250469 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.250469 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: default May 27 20:58:37.250469 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.250469 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.250469 np0000001553 nova-compute[98213]: optional May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: usb May 27 20:58:37.250469 np0000001553 nova-compute[98213]: pci May 27 20:58:37.250469 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.250469 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.250469 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: random May 27 20:58:37.250469 np0000001553 nova-compute[98213]: egd May 27 20:58:37.250469 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: path May 27 20:58:37.250469 np0000001553 nova-compute[98213]: handle May 27 20:58:37.250469 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.250469 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: usb May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: pty May 27 20:58:37.252555 np0000001553 nova-compute[98213]: unix May 27 20:58:37.252555 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.252555 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.252555 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-sparc May 27 20:58:37.252555 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.252555 np0000001553 nova-compute[98213]: SS-5 May 27 20:58:37.252555 np0000001553 nova-compute[98213]: sparc May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.252555 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: rom May 27 20:58:37.252555 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: yes May 27 20:58:37.252555 np0000001553 nova-compute[98213]: no May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: no May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.252555 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: file May 27 20:58:37.254334 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.254334 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: disk May 27 20:58:37.254334 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.254334 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.254334 np0000001553 nova-compute[98213]: lun May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.254334 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.254334 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.254334 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.254334 np0000001553 nova-compute[98213]: spice May 27 20:58:37.254334 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.254334 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: default May 27 20:58:37.254334 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.254334 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.254334 np0000001553 nova-compute[98213]: optional May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: pci May 27 20:58:37.254334 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: random May 27 20:58:37.254334 np0000001553 nova-compute[98213]: egd May 27 20:58:37.254334 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: path May 27 20:58:37.254334 np0000001553 nova-compute[98213]: handle May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.254334 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: pty May 27 20:58:37.255686 np0000001553 nova-compute[98213]: unix May 27 20:58:37.255686 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.255686 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.255686 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-sparc64 May 27 20:58:37.255686 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.255686 np0000001553 nova-compute[98213]: sun4u May 27 20:58:37.255686 np0000001553 nova-compute[98213]: sparc64 May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.255686 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: rom May 27 20:58:37.255686 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: yes May 27 20:58:37.255686 np0000001553 nova-compute[98213]: no May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: no May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.255686 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: file May 27 20:58:37.256755 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.256755 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: disk May 27 20:58:37.256755 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.256755 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.256755 np0000001553 nova-compute[98213]: lun May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: ide May 27 20:58:37.256755 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.256755 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.256755 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.256755 np0000001553 nova-compute[98213]: usb May 27 20:58:37.256755 np0000001553 nova-compute[98213]: sata May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.256755 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.256755 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.256755 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.256755 np0000001553 nova-compute[98213]: spice May 27 20:58:37.256755 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.256755 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: default May 27 20:58:37.256755 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.256755 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.256755 np0000001553 nova-compute[98213]: optional May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: usb May 27 20:58:37.256755 np0000001553 nova-compute[98213]: pci May 27 20:58:37.256755 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.256755 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.256755 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: random May 27 20:58:37.256755 np0000001553 nova-compute[98213]: egd May 27 20:58:37.256755 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.256755 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: path May 27 20:58:37.258503 np0000001553 nova-compute[98213]: handle May 27 20:58:37.258503 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: usb May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: pty May 27 20:58:37.258503 np0000001553 nova-compute[98213]: unix May 27 20:58:37.258503 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.258503 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.258503 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-x86_64 May 27 20:58:37.258503 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.258503 np0000001553 nova-compute[98213]: pc-q35-noble May 27 20:58:37.258503 np0000001553 nova-compute[98213]: x86_64 May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: efi May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: May 27 20:58:37.258503 np0000001553 nova-compute[98213]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd May 27 20:58:37.259838 np0000001553 nova-compute[98213]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd May 27 20:58:37.259838 np0000001553 nova-compute[98213]: /usr/share/ovmf/OVMF.amdsev.fd May 27 20:58:37.259838 np0000001553 nova-compute[98213]: /usr/share/OVMF/OVMF_CODE_4M.fd May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: rom May 27 20:58:37.259838 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: yes May 27 20:58:37.259838 np0000001553 nova-compute[98213]: no May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: yes May 27 20:58:37.259838 np0000001553 nova-compute[98213]: no May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: on May 27 20:58:37.259838 np0000001553 nova-compute[98213]: off May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.259838 np0000001553 nova-compute[98213]: AMD May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.259838 np0000001553 nova-compute[98213]: May 27 20:58:37.261329 np0000001553 nova-compute[98213]: May 27 20:58:37.261329 np0000001553 nova-compute[98213]: May 27 20:58:37.261329 np0000001553 nova-compute[98213]: May 27 20:58:37.261329 np0000001553 nova-compute[98213]: May 27 20:58:37.261329 np0000001553 nova-compute[98213]: May 27 20:58:37.261329 np0000001553 nova-compute[98213]: May 27 20:58:37.261329 np0000001553 nova-compute[98213]: May 27 20:58:37.261329 np0000001553 nova-compute[98213]: May 27 20:58:37.261329 np0000001553 nova-compute[98213]: qemu64 May 27 20:58:37.261329 np0000001553 nova-compute[98213]: qemu32 May 27 20:58:37.261329 np0000001553 nova-compute[98213]: phenom May 27 20:58:37.261329 np0000001553 nova-compute[98213]: pentium3 May 27 20:58:37.261329 np0000001553 nova-compute[98213]: pentium2 May 27 20:58:37.261329 np0000001553 nova-compute[98213]: pentium May 27 20:58:37.261329 np0000001553 nova-compute[98213]: n270 May 27 20:58:37.261329 np0000001553 nova-compute[98213]: kvm64 May 27 20:58:37.261329 np0000001553 nova-compute[98213]: kvm32 May 27 20:58:37.261329 np0000001553 nova-compute[98213]: coreduo May 27 20:58:37.261329 np0000001553 nova-compute[98213]: core2duo May 27 20:58:37.261329 np0000001553 nova-compute[98213]: athlon May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Westmere-IBRS May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Westmere May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Snowridge May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Skylake-Server-noTSX-IBRS May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Skylake-Server-IBRS May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Skylake-Server May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Skylake-Client-noTSX-IBRS May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Skylake-Client-IBRS May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Skylake-Client May 27 20:58:37.261329 np0000001553 nova-compute[98213]: SapphireRapids May 27 20:58:37.261329 np0000001553 nova-compute[98213]: SandyBridge-IBRS May 27 20:58:37.261329 np0000001553 nova-compute[98213]: SandyBridge May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Penryn May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Opteron_G5 May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Opteron_G4 May 27 20:58:37.261329 np0000001553 nova-compute[98213]: Opteron_G3 May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Opteron_G2 May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Opteron_G1 May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Nehalem-IBRS May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Nehalem May 27 20:58:37.261933 np0000001553 nova-compute[98213]: IvyBridge-IBRS May 27 20:58:37.261933 np0000001553 nova-compute[98213]: IvyBridge May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Icelake-Server-noTSX May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Icelake-Server May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Haswell-noTSX-IBRS May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Haswell-noTSX May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Haswell-IBRS May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Haswell May 27 20:58:37.261933 np0000001553 nova-compute[98213]: EPYC-Rome May 27 20:58:37.261933 np0000001553 nova-compute[98213]: EPYC-Milan May 27 20:58:37.261933 np0000001553 nova-compute[98213]: EPYC-IBPB May 27 20:58:37.261933 np0000001553 nova-compute[98213]: EPYC-Genoa May 27 20:58:37.261933 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Dhyana May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Cooperlake May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Conroe May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Cascadelake-Server-noTSX May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Cascadelake-Server May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Broadwell-noTSX-IBRS May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Broadwell-noTSX May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Broadwell-IBRS May 27 20:58:37.261933 np0000001553 nova-compute[98213]: Broadwell May 27 20:58:37.261933 np0000001553 nova-compute[98213]: 486 May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.261933 np0000001553 nova-compute[98213]: file May 27 20:58:37.261933 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.261933 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.261933 np0000001553 nova-compute[98213]: disk May 27 20:58:37.261933 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.261933 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.261933 np0000001553 nova-compute[98213]: lun May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.261933 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.262693 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.262693 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.262693 np0000001553 nova-compute[98213]: usb May 27 20:58:37.262693 np0000001553 nova-compute[98213]: sata May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.262693 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.262693 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.262693 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.262693 np0000001553 nova-compute[98213]: spice May 27 20:58:37.262693 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.262693 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: default May 27 20:58:37.262693 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.262693 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.262693 np0000001553 nova-compute[98213]: optional May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: usb May 27 20:58:37.262693 np0000001553 nova-compute[98213]: pci May 27 20:58:37.262693 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.262693 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.262693 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: random May 27 20:58:37.262693 np0000001553 nova-compute[98213]: egd May 27 20:58:37.262693 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: path May 27 20:58:37.262693 np0000001553 nova-compute[98213]: handle May 27 20:58:37.262693 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.262693 np0000001553 nova-compute[98213]: tpm-crb May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.262693 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.264317 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.264317 np0000001553 nova-compute[98213]: external May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.264317 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: usb May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: pty May 27 20:58:37.264317 np0000001553 nova-compute[98213]: unix May 27 20:58:37.264317 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: relaxed May 27 20:58:37.264317 np0000001553 nova-compute[98213]: vapic May 27 20:58:37.264317 np0000001553 nova-compute[98213]: spinlocks May 27 20:58:37.264317 np0000001553 nova-compute[98213]: vpindex May 27 20:58:37.264317 np0000001553 nova-compute[98213]: runtime May 27 20:58:37.264317 np0000001553 nova-compute[98213]: synic May 27 20:58:37.264317 np0000001553 nova-compute[98213]: stimer May 27 20:58:37.264317 np0000001553 nova-compute[98213]: reset May 27 20:58:37.264317 np0000001553 nova-compute[98213]: vendor_id May 27 20:58:37.264317 np0000001553 nova-compute[98213]: frequencies May 27 20:58:37.264317 np0000001553 nova-compute[98213]: reenlightenment May 27 20:58:37.264317 np0000001553 nova-compute[98213]: tlbflush May 27 20:58:37.264317 np0000001553 nova-compute[98213]: ipi May 27 20:58:37.264317 np0000001553 nova-compute[98213]: avic May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.264317 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: May 27 20:58:37.264317 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-x86_64 May 27 20:58:37.264317 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.264317 np0000001553 nova-compute[98213]: pc-q35-noble-v2 May 27 20:58:37.264317 np0000001553 nova-compute[98213]: x86_64 May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: efi May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd May 27 20:58:37.265606 np0000001553 nova-compute[98213]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd May 27 20:58:37.265606 np0000001553 nova-compute[98213]: /usr/share/ovmf/OVMF.amdsev.fd May 27 20:58:37.265606 np0000001553 nova-compute[98213]: /usr/share/OVMF/OVMF_CODE_4M.fd May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: rom May 27 20:58:37.265606 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: yes May 27 20:58:37.265606 np0000001553 nova-compute[98213]: no May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: yes May 27 20:58:37.265606 np0000001553 nova-compute[98213]: no May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: on May 27 20:58:37.265606 np0000001553 nova-compute[98213]: off May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.265606 np0000001553 nova-compute[98213]: AMD May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.265606 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: May 27 20:58:37.266547 np0000001553 nova-compute[98213]: qemu64 May 27 20:58:37.266547 np0000001553 nova-compute[98213]: qemu32 May 27 20:58:37.266547 np0000001553 nova-compute[98213]: phenom May 27 20:58:37.266547 np0000001553 nova-compute[98213]: pentium3 May 27 20:58:37.266547 np0000001553 nova-compute[98213]: pentium2 May 27 20:58:37.266547 np0000001553 nova-compute[98213]: pentium May 27 20:58:37.266547 np0000001553 nova-compute[98213]: n270 May 27 20:58:37.266547 np0000001553 nova-compute[98213]: kvm64 May 27 20:58:37.266547 np0000001553 nova-compute[98213]: kvm32 May 27 20:58:37.266547 np0000001553 nova-compute[98213]: coreduo May 27 20:58:37.266547 np0000001553 nova-compute[98213]: core2duo May 27 20:58:37.266547 np0000001553 nova-compute[98213]: athlon May 27 20:58:37.266547 np0000001553 nova-compute[98213]: Westmere-IBRS May 27 20:58:37.266547 np0000001553 nova-compute[98213]: Westmere May 27 20:58:37.266547 np0000001553 nova-compute[98213]: Snowridge May 27 20:58:37.266547 np0000001553 nova-compute[98213]: Skylake-Server-noTSX-IBRS May 27 20:58:37.266547 np0000001553 nova-compute[98213]: Skylake-Server-IBRS May 27 20:58:37.266547 np0000001553 nova-compute[98213]: Skylake-Server May 27 20:58:37.266547 np0000001553 nova-compute[98213]: Skylake-Client-noTSX-IBRS May 27 20:58:37.266547 np0000001553 nova-compute[98213]: Skylake-Client-IBRS May 27 20:58:37.266547 np0000001553 nova-compute[98213]: Skylake-Client May 27 20:58:37.266547 np0000001553 nova-compute[98213]: SapphireRapids May 27 20:58:37.266547 np0000001553 nova-compute[98213]: SandyBridge-IBRS May 27 20:58:37.266547 np0000001553 nova-compute[98213]: SandyBridge May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Penryn May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Opteron_G5 May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Opteron_G4 May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Opteron_G3 May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Opteron_G2 May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Opteron_G1 May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Nehalem-IBRS May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Nehalem May 27 20:58:37.267235 np0000001553 nova-compute[98213]: IvyBridge-IBRS May 27 20:58:37.267235 np0000001553 nova-compute[98213]: IvyBridge May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Icelake-Server-noTSX May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Icelake-Server May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Haswell-noTSX-IBRS May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Haswell-noTSX May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Haswell-IBRS May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Haswell May 27 20:58:37.267235 np0000001553 nova-compute[98213]: EPYC-Rome May 27 20:58:37.267235 np0000001553 nova-compute[98213]: EPYC-Milan May 27 20:58:37.267235 np0000001553 nova-compute[98213]: EPYC-IBPB May 27 20:58:37.267235 np0000001553 nova-compute[98213]: EPYC-Genoa May 27 20:58:37.267235 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Dhyana May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Cooperlake May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Conroe May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Cascadelake-Server-noTSX May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Cascadelake-Server May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Broadwell-noTSX-IBRS May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Broadwell-noTSX May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Broadwell-IBRS May 27 20:58:37.267235 np0000001553 nova-compute[98213]: Broadwell May 27 20:58:37.267235 np0000001553 nova-compute[98213]: 486 May 27 20:58:37.267235 np0000001553 nova-compute[98213]: May 27 20:58:37.267235 np0000001553 nova-compute[98213]: May 27 20:58:37.267235 np0000001553 nova-compute[98213]: May 27 20:58:37.267235 np0000001553 nova-compute[98213]: May 27 20:58:37.267235 np0000001553 nova-compute[98213]: file May 27 20:58:37.267235 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.267235 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.267235 np0000001553 nova-compute[98213]: May 27 20:58:37.267235 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: disk May 27 20:58:37.267892 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.267892 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.267892 np0000001553 nova-compute[98213]: lun May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.267892 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.267892 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.267892 np0000001553 nova-compute[98213]: usb May 27 20:58:37.267892 np0000001553 nova-compute[98213]: sata May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.267892 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.267892 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.267892 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.267892 np0000001553 nova-compute[98213]: spice May 27 20:58:37.267892 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.267892 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: default May 27 20:58:37.267892 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.267892 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.267892 np0000001553 nova-compute[98213]: optional May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: usb May 27 20:58:37.267892 np0000001553 nova-compute[98213]: pci May 27 20:58:37.267892 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.267892 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.267892 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: random May 27 20:58:37.267892 np0000001553 nova-compute[98213]: egd May 27 20:58:37.267892 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: May 27 20:58:37.267892 np0000001553 nova-compute[98213]: path May 27 20:58:37.267892 np0000001553 nova-compute[98213]: handle May 27 20:58:37.269086 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.269086 np0000001553 nova-compute[98213]: tpm-crb May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.269086 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.269086 np0000001553 nova-compute[98213]: external May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.269086 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: usb May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: pty May 27 20:58:37.269086 np0000001553 nova-compute[98213]: unix May 27 20:58:37.269086 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: relaxed May 27 20:58:37.269086 np0000001553 nova-compute[98213]: vapic May 27 20:58:37.269086 np0000001553 nova-compute[98213]: spinlocks May 27 20:58:37.269086 np0000001553 nova-compute[98213]: vpindex May 27 20:58:37.269086 np0000001553 nova-compute[98213]: runtime May 27 20:58:37.269086 np0000001553 nova-compute[98213]: synic May 27 20:58:37.269086 np0000001553 nova-compute[98213]: stimer May 27 20:58:37.269086 np0000001553 nova-compute[98213]: reset May 27 20:58:37.269086 np0000001553 nova-compute[98213]: vendor_id May 27 20:58:37.269086 np0000001553 nova-compute[98213]: frequencies May 27 20:58:37.269086 np0000001553 nova-compute[98213]: reenlightenment May 27 20:58:37.269086 np0000001553 nova-compute[98213]: tlbflush May 27 20:58:37.269086 np0000001553 nova-compute[98213]: ipi May 27 20:58:37.269086 np0000001553 nova-compute[98213]: avic May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: May 27 20:58:37.269086 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.270300 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-x86_64 May 27 20:58:37.270300 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.270300 np0000001553 nova-compute[98213]: pc-i440fx-noble-v2 May 27 20:58:37.270300 np0000001553 nova-compute[98213]: x86_64 May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: efi May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: /usr/share/OVMF/OVMF_CODE_4M.fd May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: rom May 27 20:58:37.270300 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: yes May 27 20:58:37.270300 np0000001553 nova-compute[98213]: no May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: no May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: on May 27 20:58:37.270300 np0000001553 nova-compute[98213]: off May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.270300 np0000001553 nova-compute[98213]: AMD May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.270300 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: May 27 20:58:37.271273 np0000001553 nova-compute[98213]: qemu64 May 27 20:58:37.271273 np0000001553 nova-compute[98213]: qemu32 May 27 20:58:37.271273 np0000001553 nova-compute[98213]: phenom May 27 20:58:37.271273 np0000001553 nova-compute[98213]: pentium3 May 27 20:58:37.271273 np0000001553 nova-compute[98213]: pentium2 May 27 20:58:37.271273 np0000001553 nova-compute[98213]: pentium May 27 20:58:37.271273 np0000001553 nova-compute[98213]: n270 May 27 20:58:37.271273 np0000001553 nova-compute[98213]: kvm64 May 27 20:58:37.271273 np0000001553 nova-compute[98213]: kvm32 May 27 20:58:37.271273 np0000001553 nova-compute[98213]: coreduo May 27 20:58:37.271273 np0000001553 nova-compute[98213]: core2duo May 27 20:58:37.271273 np0000001553 nova-compute[98213]: athlon May 27 20:58:37.271273 np0000001553 nova-compute[98213]: Westmere-IBRS May 27 20:58:37.271273 np0000001553 nova-compute[98213]: Westmere May 27 20:58:37.271273 np0000001553 nova-compute[98213]: Snowridge May 27 20:58:37.271273 np0000001553 nova-compute[98213]: Skylake-Server-noTSX-IBRS May 27 20:58:37.271273 np0000001553 nova-compute[98213]: Skylake-Server-IBRS May 27 20:58:37.271273 np0000001553 nova-compute[98213]: Skylake-Server May 27 20:58:37.271273 np0000001553 nova-compute[98213]: Skylake-Client-noTSX-IBRS May 27 20:58:37.271273 np0000001553 nova-compute[98213]: Skylake-Client-IBRS May 27 20:58:37.271273 np0000001553 nova-compute[98213]: Skylake-Client May 27 20:58:37.271866 np0000001553 nova-compute[98213]: SapphireRapids May 27 20:58:37.271866 np0000001553 nova-compute[98213]: SandyBridge-IBRS May 27 20:58:37.271866 np0000001553 nova-compute[98213]: SandyBridge May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Penryn May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Opteron_G5 May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Opteron_G4 May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Opteron_G3 May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Opteron_G2 May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Opteron_G1 May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Nehalem-IBRS May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Nehalem May 27 20:58:37.271866 np0000001553 nova-compute[98213]: IvyBridge-IBRS May 27 20:58:37.271866 np0000001553 nova-compute[98213]: IvyBridge May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Icelake-Server-noTSX May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Icelake-Server May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Haswell-noTSX-IBRS May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Haswell-noTSX May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Haswell-IBRS May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Haswell May 27 20:58:37.271866 np0000001553 nova-compute[98213]: EPYC-Rome May 27 20:58:37.271866 np0000001553 nova-compute[98213]: EPYC-Milan May 27 20:58:37.271866 np0000001553 nova-compute[98213]: EPYC-IBPB May 27 20:58:37.271866 np0000001553 nova-compute[98213]: EPYC-Genoa May 27 20:58:37.271866 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Dhyana May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Cooperlake May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Conroe May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Cascadelake-Server-noTSX May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Cascadelake-Server May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Broadwell-noTSX-IBRS May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Broadwell-noTSX May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Broadwell-IBRS May 27 20:58:37.271866 np0000001553 nova-compute[98213]: Broadwell May 27 20:58:37.271866 np0000001553 nova-compute[98213]: 486 May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: file May 27 20:58:37.272421 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.272421 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: disk May 27 20:58:37.272421 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.272421 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.272421 np0000001553 nova-compute[98213]: lun May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: ide May 27 20:58:37.272421 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.272421 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.272421 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.272421 np0000001553 nova-compute[98213]: usb May 27 20:58:37.272421 np0000001553 nova-compute[98213]: sata May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.272421 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.272421 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.272421 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.272421 np0000001553 nova-compute[98213]: spice May 27 20:58:37.272421 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.272421 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: default May 27 20:58:37.272421 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.272421 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.272421 np0000001553 nova-compute[98213]: optional May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: usb May 27 20:58:37.272421 np0000001553 nova-compute[98213]: pci May 27 20:58:37.272421 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.272421 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.272421 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: May 27 20:58:37.272421 np0000001553 nova-compute[98213]: random May 27 20:58:37.273757 np0000001553 nova-compute[98213]: egd May 27 20:58:37.273757 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: path May 27 20:58:37.273757 np0000001553 nova-compute[98213]: handle May 27 20:58:37.273757 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.273757 np0000001553 nova-compute[98213]: tpm-crb May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.273757 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.273757 np0000001553 nova-compute[98213]: external May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.273757 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: usb May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: pty May 27 20:58:37.273757 np0000001553 nova-compute[98213]: unix May 27 20:58:37.273757 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: relaxed May 27 20:58:37.273757 np0000001553 nova-compute[98213]: vapic May 27 20:58:37.273757 np0000001553 nova-compute[98213]: spinlocks May 27 20:58:37.273757 np0000001553 nova-compute[98213]: vpindex May 27 20:58:37.273757 np0000001553 nova-compute[98213]: runtime May 27 20:58:37.273757 np0000001553 nova-compute[98213]: synic May 27 20:58:37.273757 np0000001553 nova-compute[98213]: stimer May 27 20:58:37.273757 np0000001553 nova-compute[98213]: reset May 27 20:58:37.273757 np0000001553 nova-compute[98213]: vendor_id May 27 20:58:37.273757 np0000001553 nova-compute[98213]: frequencies May 27 20:58:37.273757 np0000001553 nova-compute[98213]: reenlightenment May 27 20:58:37.273757 np0000001553 nova-compute[98213]: tlbflush May 27 20:58:37.273757 np0000001553 nova-compute[98213]: ipi May 27 20:58:37.273757 np0000001553 nova-compute[98213]: avic May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.273757 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.275099 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-x86_64 May 27 20:58:37.275099 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.275099 np0000001553 nova-compute[98213]: pc-i440fx-noble May 27 20:58:37.275099 np0000001553 nova-compute[98213]: x86_64 May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: efi May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: /usr/share/OVMF/OVMF_CODE_4M.fd May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: rom May 27 20:58:37.275099 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: yes May 27 20:58:37.275099 np0000001553 nova-compute[98213]: no May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: no May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: on May 27 20:58:37.275099 np0000001553 nova-compute[98213]: off May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.275099 np0000001553 nova-compute[98213]: AMD May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.275099 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: May 27 20:58:37.276084 np0000001553 nova-compute[98213]: qemu64 May 27 20:58:37.276084 np0000001553 nova-compute[98213]: qemu32 May 27 20:58:37.276084 np0000001553 nova-compute[98213]: phenom May 27 20:58:37.276084 np0000001553 nova-compute[98213]: pentium3 May 27 20:58:37.276084 np0000001553 nova-compute[98213]: pentium2 May 27 20:58:37.276084 np0000001553 nova-compute[98213]: pentium May 27 20:58:37.276084 np0000001553 nova-compute[98213]: n270 May 27 20:58:37.276084 np0000001553 nova-compute[98213]: kvm64 May 27 20:58:37.276084 np0000001553 nova-compute[98213]: kvm32 May 27 20:58:37.276084 np0000001553 nova-compute[98213]: coreduo May 27 20:58:37.276084 np0000001553 nova-compute[98213]: core2duo May 27 20:58:37.276084 np0000001553 nova-compute[98213]: athlon May 27 20:58:37.276084 np0000001553 nova-compute[98213]: Westmere-IBRS May 27 20:58:37.276084 np0000001553 nova-compute[98213]: Westmere May 27 20:58:37.276084 np0000001553 nova-compute[98213]: Snowridge May 27 20:58:37.276084 np0000001553 nova-compute[98213]: Skylake-Server-noTSX-IBRS May 27 20:58:37.276084 np0000001553 nova-compute[98213]: Skylake-Server-IBRS May 27 20:58:37.276084 np0000001553 nova-compute[98213]: Skylake-Server May 27 20:58:37.276084 np0000001553 nova-compute[98213]: Skylake-Client-noTSX-IBRS May 27 20:58:37.276084 np0000001553 nova-compute[98213]: Skylake-Client-IBRS May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Skylake-Client May 27 20:58:37.276733 np0000001553 nova-compute[98213]: SapphireRapids May 27 20:58:37.276733 np0000001553 nova-compute[98213]: SandyBridge-IBRS May 27 20:58:37.276733 np0000001553 nova-compute[98213]: SandyBridge May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Penryn May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Opteron_G5 May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Opteron_G4 May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Opteron_G3 May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Opteron_G2 May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Opteron_G1 May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Nehalem-IBRS May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Nehalem May 27 20:58:37.276733 np0000001553 nova-compute[98213]: IvyBridge-IBRS May 27 20:58:37.276733 np0000001553 nova-compute[98213]: IvyBridge May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Icelake-Server-noTSX May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Icelake-Server May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Haswell-noTSX-IBRS May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Haswell-noTSX May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Haswell-IBRS May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Haswell May 27 20:58:37.276733 np0000001553 nova-compute[98213]: EPYC-Rome May 27 20:58:37.276733 np0000001553 nova-compute[98213]: EPYC-Milan May 27 20:58:37.276733 np0000001553 nova-compute[98213]: EPYC-IBPB May 27 20:58:37.276733 np0000001553 nova-compute[98213]: EPYC-Genoa May 27 20:58:37.276733 np0000001553 nova-compute[98213]: EPYC May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Dhyana May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Cooperlake May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Conroe May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Cascadelake-Server-noTSX May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Cascadelake-Server May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Broadwell-noTSX-IBRS May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Broadwell-noTSX May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Broadwell-IBRS May 27 20:58:37.276733 np0000001553 nova-compute[98213]: Broadwell May 27 20:58:37.277343 np0000001553 nova-compute[98213]: 486 May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: file May 27 20:58:37.277343 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.277343 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: disk May 27 20:58:37.277343 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.277343 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.277343 np0000001553 nova-compute[98213]: lun May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: ide May 27 20:58:37.277343 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.277343 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.277343 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.277343 np0000001553 nova-compute[98213]: usb May 27 20:58:37.277343 np0000001553 nova-compute[98213]: sata May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.277343 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.277343 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.277343 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.277343 np0000001553 nova-compute[98213]: spice May 27 20:58:37.277343 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.277343 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: default May 27 20:58:37.277343 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.277343 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.277343 np0000001553 nova-compute[98213]: optional May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: usb May 27 20:58:37.277343 np0000001553 nova-compute[98213]: pci May 27 20:58:37.277343 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.277343 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.277343 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.277343 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.277343 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: random May 27 20:58:37.278685 np0000001553 nova-compute[98213]: egd May 27 20:58:37.278685 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: path May 27 20:58:37.278685 np0000001553 nova-compute[98213]: handle May 27 20:58:37.278685 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: tpm-tis May 27 20:58:37.278685 np0000001553 nova-compute[98213]: tpm-crb May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: passthrough May 27 20:58:37.278685 np0000001553 nova-compute[98213]: emulator May 27 20:58:37.278685 np0000001553 nova-compute[98213]: external May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: 1.2 May 27 20:58:37.278685 np0000001553 nova-compute[98213]: 2.0 May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: usb May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: pty May 27 20:58:37.278685 np0000001553 nova-compute[98213]: unix May 27 20:58:37.278685 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.278685 np0000001553 nova-compute[98213]: relaxed May 27 20:58:37.278685 np0000001553 nova-compute[98213]: vapic May 27 20:58:37.278685 np0000001553 nova-compute[98213]: spinlocks May 27 20:58:37.278685 np0000001553 nova-compute[98213]: vpindex May 27 20:58:37.278685 np0000001553 nova-compute[98213]: runtime May 27 20:58:37.278685 np0000001553 nova-compute[98213]: synic May 27 20:58:37.278685 np0000001553 nova-compute[98213]: stimer May 27 20:58:37.278685 np0000001553 nova-compute[98213]: reset May 27 20:58:37.278685 np0000001553 nova-compute[98213]: vendor_id May 27 20:58:37.278685 np0000001553 nova-compute[98213]: frequencies May 27 20:58:37.278685 np0000001553 nova-compute[98213]: reenlightenment May 27 20:58:37.278685 np0000001553 nova-compute[98213]: tlbflush May 27 20:58:37.278685 np0000001553 nova-compute[98213]: ipi May 27 20:58:37.278685 np0000001553 nova-compute[98213]: avic May 27 20:58:37.278685 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.279952 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.279952 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-xtensa May 27 20:58:37.279952 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.279952 np0000001553 nova-compute[98213]: sim May 27 20:58:37.279952 np0000001553 nova-compute[98213]: xtensa May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.279952 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: rom May 27 20:58:37.279952 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: yes May 27 20:58:37.279952 np0000001553 nova-compute[98213]: no May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: no May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: file May 27 20:58:37.279952 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.279952 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: disk May 27 20:58:37.279952 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.279952 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.279952 np0000001553 nova-compute[98213]: lun May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.279952 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.279952 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.279952 np0000001553 nova-compute[98213]: usb May 27 20:58:37.279952 np0000001553 nova-compute[98213]: sata May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.279952 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.280933 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.280933 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.280933 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.280933 np0000001553 nova-compute[98213]: spice May 27 20:58:37.280933 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.280933 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: default May 27 20:58:37.280933 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.280933 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.280933 np0000001553 nova-compute[98213]: optional May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: usb May 27 20:58:37.280933 np0000001553 nova-compute[98213]: pci May 27 20:58:37.280933 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.280933 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.280933 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: random May 27 20:58:37.280933 np0000001553 nova-compute[98213]: egd May 27 20:58:37.280933 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: path May 27 20:58:37.280933 np0000001553 nova-compute[98213]: handle May 27 20:58:37.280933 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: usb May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: pty May 27 20:58:37.280933 np0000001553 nova-compute[98213]: unix May 27 20:58:37.280933 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.280933 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.282771 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98213) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}} May 27 20:58:37.282771 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-xtensaeb May 27 20:58:37.282771 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.282771 np0000001553 nova-compute[98213]: sim May 27 20:58:37.282771 np0000001553 nova-compute[98213]: xtensaeb May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF_CODE.fd May 27 20:58:37.282771 np0000001553 nova-compute[98213]: /usr/share/AAVMF/AAVMF32_CODE.fd May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: rom May 27 20:58:37.282771 np0000001553 nova-compute[98213]: pflash May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: yes May 27 20:58:37.282771 np0000001553 nova-compute[98213]: no May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: no May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: file May 27 20:58:37.282771 np0000001553 nova-compute[98213]: anonymous May 27 20:58:37.282771 np0000001553 nova-compute[98213]: memfd May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.282771 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: disk May 27 20:58:37.284293 np0000001553 nova-compute[98213]: cdrom May 27 20:58:37.284293 np0000001553 nova-compute[98213]: floppy May 27 20:58:37.284293 np0000001553 nova-compute[98213]: lun May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: fdc May 27 20:58:37.284293 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.284293 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.284293 np0000001553 nova-compute[98213]: usb May 27 20:58:37.284293 np0000001553 nova-compute[98213]: sata May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.284293 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.284293 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: sdl May 27 20:58:37.284293 np0000001553 nova-compute[98213]: vnc May 27 20:58:37.284293 np0000001553 nova-compute[98213]: spice May 27 20:58:37.284293 np0000001553 nova-compute[98213]: egl-headless May 27 20:58:37.284293 np0000001553 nova-compute[98213]: dbus May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: subsystem May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: default May 27 20:58:37.284293 np0000001553 nova-compute[98213]: mandatory May 27 20:58:37.284293 np0000001553 nova-compute[98213]: requisite May 27 20:58:37.284293 np0000001553 nova-compute[98213]: optional May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: usb May 27 20:58:37.284293 np0000001553 nova-compute[98213]: pci May 27 20:58:37.284293 np0000001553 nova-compute[98213]: scsi May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.284293 np0000001553 nova-compute[98213]: virtio-transitional May 27 20:58:37.284293 np0000001553 nova-compute[98213]: virtio-non-transitional May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: random May 27 20:58:37.284293 np0000001553 nova-compute[98213]: egd May 27 20:58:37.284293 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: path May 27 20:58:37.284293 np0000001553 nova-compute[98213]: handle May 27 20:58:37.284293 np0000001553 nova-compute[98213]: virtiofs May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.284293 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: usb May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: pty May 27 20:58:37.285705 np0000001553 nova-compute[98213]: unix May 27 20:58:37.285705 np0000001553 nova-compute[98213]: spicevmc May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: virtio May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: qemu May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: builtin May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: May 27 20:58:37.285705 np0000001553 nova-compute[98213]: {{(pid=98213) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}} May 27 20:58:37.285705 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Checking secure boot support for host arch (x86_64) {{(pid=98213) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}} May 27 20:58:37.285705 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Secure Boot support detected May 27 20:58:37.710125 np0000001553 nova-compute[98213]: INFO nova.virt.node [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Generated node identity 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 May 27 20:58:37.710341 np0000001553 nova-compute[98213]: INFO nova.virt.node [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Wrote node identity 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 to /opt/stack/data/nova/compute_id May 27 20:58:38.212795 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Compute nodes ['486c0dc2-4a11-4ae8-b90f-d5afcfe85804'] for host np0000001553 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. May 27 20:58:39.217270 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host May 27 20:58:40.221719 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] No compute node record found for host np0000001553. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001553 could not be found. May 27 20:58:40.222241 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 20:58:40.222241 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 20:58:40.222241 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 20:58:40.222241 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Auditing locally available compute resources for np0000001553 (node: np0000001553) {{(pid=98213) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} May 27 20:58:40.297704 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 20:58:40.298576 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 20:58:40.314158 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 20:58:40.314477 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Hypervisor/Node resource view: name=np0000001553 free_ram=16518MB free_disk=75.21672058105469GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98213) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} May 27 20:58:40.314634 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 20:58:40.314930 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 20:58:40.818231 np0000001553 nova-compute[98213]: WARNING nova.compute.resource_tracker [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] No compute node record for np0000001553:486c0dc2-4a11-4ae8-b90f-d5afcfe85804: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 could not be found. May 27 20:58:41.322961 np0000001553 nova-compute[98213]: INFO nova.compute.resource_tracker [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Compute node record created for np0000001553:np0000001553 with uuid: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 May 27 20:58:42.829849 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} May 27 20:58:42.830439 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Final resource view: name=np0000001553 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 20:58:40 up 24 min, 2 users, load average: 2.49, 1.46, 0.74\n'} {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} May 27 20:58:43.320418 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] [req-dc64a2b7-4d0b-4bd4-86a2-02680241d81f] Created resource provider record via placement API for resource provider with UUID 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 and name np0000001553. May 27 20:58:43.373072 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] /sys/module/kvm_amd/parameters/sev contains [N May 27 20:58:43.373072 np0000001553 nova-compute[98213]: ] {{(pid=98213) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}} May 27 20:58:43.373303 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.host [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] kernel doesn't support AMD SEV May 27 20:58:43.373524 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 20:58:43.373742 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Updating inventory in ProviderTree for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} May 27 20:58:43.374041 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 20:58:43.378954 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Libvirt baseline CPU May 27 20:58:43.378954 np0000001553 nova-compute[98213]: x86_64 May 27 20:58:43.378954 np0000001553 nova-compute[98213]: Nehalem May 27 20:58:43.378954 np0000001553 nova-compute[98213]: AMD May 27 20:58:43.378954 np0000001553 nova-compute[98213]: May 27 20:58:43.378954 np0000001553 nova-compute[98213]: May 27 20:58:43.378954 np0000001553 nova-compute[98213]: May 27 20:58:43.378954 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}} May 27 20:58:43.938402 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Updated inventory for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}} May 27 20:58:43.938849 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Updating resource provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 generation from 0 to 1 during operation: update_inventory {{(pid=98213) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} May 27 20:58:43.938849 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Updating inventory in ProviderTree for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} May 27 20:58:44.076245 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Updating resource provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 generation from 1 to 2 during operation: update_traits {{(pid=98213) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} May 27 20:58:44.584154 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Compute_service record updated for np0000001553:np0000001553 {{(pid=98213) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} May 27 20:58:44.584304 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.269s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 20:58:44.584479 np0000001553 nova-compute[98213]: DEBUG nova.service [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98213) start /opt/stack/nova/nova/service.py:195}} May 27 20:58:44.598884 np0000001553 nova-compute[98213]: DEBUG nova.service [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98213) start /opt/stack/nova/nova/service.py:211}} May 27 20:58:44.612863 np0000001553 nova-compute[98213]: DEBUG nova.service [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] Join ServiceGroup membership for this service compute {{(pid=98213) start /opt/stack/nova/nova/service.py:221}} May 27 20:58:44.613041 np0000001553 nova-compute[98213]: DEBUG nova.servicegroup.drivers.db [None req-b1c67ac6-5485-45b2-bc0d-6f7760e7e16e None None] DB_Driver: join new ServiceGroup member np0000001553 to the compute group, service = {{(pid=98213) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} May 27 20:58:50.116659 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 20:59:41.614628 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 20:59:41.615283 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 20:59:41.616600 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 20:59:41.617063 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 20:59:41.617063 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 20:59:41.617428 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 20:59:41.618481 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._sync_power_states {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 20:59:42.120300 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 20:59:42.120300 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98213) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} May 27 20:59:42.120640 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager.update_available_resource {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 20:59:42.623870 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 20:59:42.624720 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 20:59:42.625087 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 20:59:42.625875 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Auditing locally available compute resources for np0000001553 (node: np0000001553) {{(pid=98213) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} May 27 20:59:42.634038 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 20:59:42.637884 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 20:59:42.652686 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "env LANG=C uptime" returned: 0 in 0.017s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 20:59:42.653610 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Hypervisor/Node resource view: name=np0000001553 free_ram=16276MB free_disk=74.97345733642578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98213) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} May 27 20:59:42.654085 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 20:59:42.654547 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 20:59:43.708865 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} May 27 20:59:43.712284 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Final resource view: name=np0000001553 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 20:59:42 up 25 min, 2 users, load average: 1.79, 1.46, 0.79\n'} {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} May 27 20:59:43.756305 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 20:59:43.756305 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 20:59:44.260167 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 20:59:44.765344 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Compute_service record updated for np0000001553:np0000001553 {{(pid=98213) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} May 27 20:59:44.765344 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.111s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 20:59:44.766354 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 20:59:44.767314 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.04 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:00:26.807778 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:00:26.808278 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:00:26.808278 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:00:26.808464 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:00:26.808585 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:00:26.808754 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:00:26.808928 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:00:26.809085 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:00:26.809219 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98213) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} May 27 21:00:26.809380 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager.update_available_resource {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:00:27.312752 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:00:27.312919 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:00:27.312997 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:00:27.313221 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Auditing locally available compute resources for np0000001553 (node: np0000001553) {{(pid=98213) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} May 27 21:00:27.322002 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:00:27.322796 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:00:27.337943 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:00:27.338300 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Hypervisor/Node resource view: name=np0000001553 free_ram=16376MB free_disk=74.89266586303711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98213) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} May 27 21:00:27.338445 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:00:27.338692 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:00:28.388718 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} May 27 21:00:28.389248 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Final resource view: name=np0000001553 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 21:00:27 up 26 min, 2 users, load average: 1.32, 1.38, 0.80\n'} {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} May 27 21:00:28.431088 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:00:28.431307 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:00:28.933706 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:00:29.439047 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Compute_service record updated for np0000001553:np0000001553 {{(pid=98213) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} May 27 21:00:29.439601 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.100s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:00:29.439601 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:00:50.119049 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:01:05.623331 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "f4397c41-4087-4367-b1ac-46e8cc475772" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:05.624002 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "f4397c41-4087-4367-b1ac-46e8cc475772" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:06.125735 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:06.735179 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:06.735720 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:06.744161 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:06.744161 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Claim successful on node np0000001553 May 27 21:01:07.977683 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:07.978262 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:08.227856 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:08.228052 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:08.278387 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:08.278579 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:08.481024 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:08.733113 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:08.780880 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:08.990853 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.255s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:08.991400 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:09.282851 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:09.283122 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:09.286670 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:09.286879 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Claim successful on node np0000001553 May 27 21:01:09.330755 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:09.498925 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:09.498992 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:09.499943 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:09.501632 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:10.005829 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:01:10.140860 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18e30c231082464ab556592986d8b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fe4bede0c741bfb93a23985eeef42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:10.234695 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:10.234925 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:10.509868 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:10.581640 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:10.581923 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:10.737217 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:11.089354 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:11.289200 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:11.522811 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:11.522994 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:11.523310 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Creating image(s) May 27 21:01:11.523771 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:11.523849 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:11.524313 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:11.524635 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:11.526062 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:11.596266 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.313s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:11.596796 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:11.600097 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.270s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:11.603810 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:11.603955 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Claim successful on node np0000001553 May 27 21:01:11.848230 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:11.850618 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:11.851065 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f.part --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:11.908978 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f.part --force-share --output=json" returned: 0 in 0.058s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:11.909550 np0000001553 nova-compute[98213]: DEBUG nova.virt.images [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] 58b1bbfa-5e93-4445-8446-fffa20b98b42 was qcow2, converting to raw {{(pid=98213) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} May 27 21:01:11.910170 np0000001553 nova-compute[98213]: DEBUG nova.privsep.utils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98213) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} May 27 21:01:11.910449 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f.part /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f.converted {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:12.033230 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f.part /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f.converted" returned: 0 in 0.122s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:12.038207 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f.converted --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:12.097165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f.converted --force-share --output=json" returned: 0 in 0.059s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:12.097932 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.573s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:12.098443 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:12.104531 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:12.107163 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:12.108160 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:12.108852 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:12.109111 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:12.115203 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmph_qcwljl/privsep.sock'] May 27 21:01:12.124511 np0000001553 sudo[109810]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmph_qcwljl/privsep.sock May 27 21:01:12.125256 np0000001553 sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) May 27 21:01:12.369555 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: May 27 21:01:12.369727 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and May 27 21:01:12.369765 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. May 27 21:01:12.369843 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:12.369910 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different May 27 21:01:12.369980 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see May 27 21:01:12.370051 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html May 27 21:01:12.370116 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:12.370201 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher May 27 21:01:12.609263 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:01:12.613244 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6e7f263d257406d8c7b8ab607d0e609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92da496690954c8fb9c6eb722b956485', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:12.625794 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Successfully created port: be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:12.675739 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: May 27 21:01:12.675937 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and May 27 21:01:12.675937 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. May 27 21:01:12.675937 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:12.676043 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different May 27 21:01:12.676043 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see May 27 21:01:12.676043 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html May 27 21:01:12.676185 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:12.676232 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) May 27 21:01:12.945243 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:12.945243 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:12.953264 np0000001553 sudo[109810]: pam_unix(sudo:session): session closed for user root May 27 21:01:12.955079 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Spawned new privsep daemon via rootwrap May 27 21:01:12.955670 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [-] privsep daemon starting May 27 21:01:12.955802 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 May 27 21:01:12.955897 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none May 27 21:01:12.956006 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109814 May 27 21:01:13.021185 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:13.089240 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.068s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:13.089812 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:13.090501 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:13.091029 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:13.095089 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:13.095622 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:13.115925 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:13.166055 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.070s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:13.166780 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:13.196759 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk 1073741824" returned: 0 in 0.029s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:13.197821 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.107s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:13.198283 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:13.268006 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.069s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:13.268978 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:01:13.269373 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:13.335272 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:13.335708 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Cannot resize image /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:01:13.336315 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:01:13.336528 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Ensure instance console log exists: /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:13.336811 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:13.337055 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:13.337232 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:13.448500 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:13.770906 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Successfully updated port: be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:13.957530 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.357s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:13.958336 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.669s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:13.958484 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:13.962728 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:13.964829 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Claim successful on node np0000001553 May 27 21:01:14.017709 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Successfully created port: b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:14.127758 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:14.127758 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:14.127758 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Creating image(s) May 27 21:01:14.127758 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "/opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:14.127758 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "/opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:14.128847 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "/opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:14.129442 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:14.132257 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:14.134026 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:14.222235 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.088s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:14.225706 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:14.225706 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:14.225706 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:14.227882 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:14.228442 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:14.275111 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "refresh_cache-f4397c41-4087-4367-b1ac-46e8cc475772" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:14.275286 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquired lock "refresh_cache-f4397c41-4087-4367-b1ac-46e8cc475772" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:14.275548 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:14.314739 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.086s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:14.318168 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:14.354014 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk 1073741824" returned: 0 in 0.038s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:14.355273 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.131s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:14.356273 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:14.424319 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.068s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:14.424546 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:01:14.424755 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:14.473663 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:14.473663 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:14.473991 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:14.474404 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:14.484972 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json" returned: 0 in 0.060s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:14.486397 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Cannot resize image /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:01:14.486397 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:01:14.486397 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Ensure instance console log exists: /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:14.486856 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:14.487045 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:14.487220 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:14.540557 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-520f8540-0933-404a-b744-ef3b44ad8d4e req-44b1d99c-d3a4-4d28-bfc2-cb35a39a13c6 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received event network-changed-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:14.540774 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-520f8540-0933-404a-b744-ef3b44ad8d4e req-44b1d99c-d3a4-4d28-bfc2-cb35a39a13c6 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Refreshing instance network info cache due to event network-changed-be1aa92c-fc86-4acd-8cae-2a0feb29f6df. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:14.541264 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-520f8540-0933-404a-b744-ef3b44ad8d4e req-44b1d99c-d3a4-4d28-bfc2-cb35a39a13c6 service nova] Acquiring lock "refresh_cache-f4397c41-4087-4367-b1ac-46e8cc475772" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:14.590669 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99659c2947e743c899512883f5a85b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562b6a1ba2b4c3ab101af22f9d04713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:14.664056 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Successfully updated port: b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:14.667049 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:14.667049 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:14.907814 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:14.975136 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:01:15.163377 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:15.168828 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:15.168953 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquired lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:15.169103 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:15.172451 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:15.275168 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Successfully created port: 44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:15.315208 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:15.315519 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:15.365693 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Updating instance_info_cache with network_info: [{"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:15.369049 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-28a24646-fb46-4bb0-80ba-0ff5eb8f9981 req-f3535261-0225-4a39-ac51-ee7b91380cc6 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-changed-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:15.369366 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-28a24646-fb46-4bb0-80ba-0ff5eb8f9981 req-f3535261-0225-4a39-ac51-ee7b91380cc6 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Refreshing instance network info cache due to event network-changed-b8698723-2577-4f03-aa99-ea06a904c148. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:15.369540 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-28a24646-fb46-4bb0-80ba-0ff5eb8f9981 req-f3535261-0225-4a39-ac51-ee7b91380cc6 service nova] Acquiring lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:15.410534 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:15.410888 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:15.478531 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:15.735544 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:15.817459 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:15.835811 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:15.854027 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Successfully updated port: 44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:15.869757 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Releasing lock "refresh_cache-f4397c41-4087-4367-b1ac-46e8cc475772" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:15.870044 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Instance network_info: |[{"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:15.870544 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-520f8540-0933-404a-b744-ef3b44ad8d4e req-44b1d99c-d3a4-4d28-bfc2-cb35a39a13c6 service nova] Acquired lock "refresh_cache-f4397c41-4087-4367-b1ac-46e8cc475772" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:15.870798 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-520f8540-0933-404a-b744-ef3b44ad8d4e req-44b1d99c-d3a4-4d28-bfc2-cb35a39a13c6 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Refreshing network info cache for port be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:15.874026 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Start _get_guest_xml network_info=[{"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:15.876178 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:15.877914 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-157525005', uuid='f4397c41-4087-4367-b1ac-46e8cc475772'), owner=OwnerMeta(userid='18e30c231082464ab556592986d8b793', username='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member', projectid='79fe4bede0c741bfb93a23985eeef42e', projectname='tempest-ServerBootFromVolumeStableRescueTest-1106755838'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915675.877272) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:15.879077 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:15.879469 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:15.880916 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:15.881088 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:15.882266 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:15.882602 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:15.882758 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:15.882869 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:15.883351 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:15.883454 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:15.883570 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:15.883740 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:15.884247 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:15.884668 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:15.884791 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:15.884929 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:15.895941 np0000001553 nova-compute[98213]: DEBUG nova.privsep.utils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98213) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} May 27 21:01:15.897181 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-157525005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-157525005',id=1,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-s3ah9e66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:11Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=f4397c41-4087-4367-b1ac-46e8cc475772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:15.897362 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:15.898179 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:b3,bridge_name='br-int',has_traffic_filtering=True,id=be1aa92c-fc86-4acd-8cae-2a0feb29f6df,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe1aa92c-fc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:15.899073 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'pci_devices' on Instance uuid f4397c41-4087-4367-b1ac-46e8cc475772 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:15.913662 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:16.033533 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:16.174388 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updating instance_info_cache with network_info: [{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:16.356973 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "refresh_cache-f0c8ea02-9725-47ed-b34b-13ea3552d09b" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:16.357065 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquired lock "refresh_cache-f0c8ea02-9725-47ed-b34b-13ea3552d09b" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:16.357221 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:16.376954 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-520f8540-0933-404a-b744-ef3b44ad8d4e req-44b1d99c-d3a4-4d28-bfc2-cb35a39a13c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:16.384770 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:16.401748 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] End _get_guest_xml xml= May 27 21:01:16.401748 np0000001553 nova-compute[98213]: f4397c41-4087-4367-b1ac-46e8cc475772 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: instance-00000001 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 196608 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 1 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-server-157525005 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 2026-05-27 21:01:15 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 192 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 1 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 0 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 0 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 1 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: True May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: bare May 27 21:01:16.401748 np0000001553 nova-compute[98213]: qcow2 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 1 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 0 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: virtio May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member May 27 21:01:16.401748 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:16.401748 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: f4397c41-4087-4367-b1ac-46e8cc475772 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: f4397c41-4087-4367-b1ac-46e8cc475772 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: hvm May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 128 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: 1 May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: May 27 21:01:16.401748 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:16.403867 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Preparing to wait for external event network-vif-plugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:16.403867 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:16.403867 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:16.403867 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:16.403867 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-157525005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-157525005',id=1,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-s3ah9e66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:11Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=f4397c41-4087-4367-b1ac-46e8cc475772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:16.404272 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:16.404272 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:b3,bridge_name='br-int',has_traffic_filtering=True,id=be1aa92c-fc86-4acd-8cae-2a0feb29f6df,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe1aa92c-fc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:16.404272 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:b3,bridge_name='br-int',has_traffic_filtering=True,id=be1aa92c-fc86-4acd-8cae-2a0feb29f6df,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe1aa92c-fc') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:16.420502 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.463s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:16.420879 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:16.423373 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.688s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:16.431354 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:16.433289 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Claim successful on node np0000001553 May 27 21:01:16.458966 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Created schema index Interface.name {{(pid=98213) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 27 21:01:16.459090 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Created schema index Port.name {{(pid=98213) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 27 21:01:16.459193 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Created schema index Bridge.name {{(pid=98213) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 27 21:01:16.459766 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98213) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} May 27 21:01:16.459929 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [POLLOUT] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:16.460038 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98213) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} May 27 21:01:16.460548 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:16.488637 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:16.501687 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:16.504713 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:16.504944 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:16.505354 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Creating image(s) May 27 21:01:16.505924 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:16.506107 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:16.506331 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "/opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:16.508317 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:16.508530 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41b44fa9-c3ce-5ee9-9557-2f52bf1ad072', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:16.509225 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "/opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:16.509327 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:16.509950 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:16.512454 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:16.515711 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:16.517152 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:16.527923 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp6uod80xh/privsep.sock'] May 27 21:01:16.537844 np0000001553 sudo[109908]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp6uod80xh/privsep.sock May 27 21:01:16.538797 np0000001553 sudo[109908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) May 27 21:01:16.584424 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.067s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:16.584929 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:16.585442 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:16.585944 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:16.590178 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:16.590178 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:16.635845 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5804d7e3-6c03-471e-9801-788e45669e0c req-9f026761-77c9-4601-8a6f-2e036c41b006 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Received event network-changed-44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:16.635966 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5804d7e3-6c03-471e-9801-788e45669e0c req-9f026761-77c9-4601-8a6f-2e036c41b006 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Refreshing instance network info cache due to event network-changed-44654d4f-25e2-4002-9a7f-af6cf7cac43c. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:16.636225 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5804d7e3-6c03-471e-9801-788e45669e0c req-9f026761-77c9-4601-8a6f-2e036c41b006 service nova] Acquiring lock "refresh_cache-f0c8ea02-9725-47ed-b34b-13ea3552d09b" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:16.646329 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:16.660549 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.070s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:16.664283 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:16.678340 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Releasing lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:16.678743 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Instance network_info: |[{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:16.679652 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-28a24646-fb46-4bb0-80ba-0ff5eb8f9981 req-f3535261-0225-4a39-ac51-ee7b91380cc6 service nova] Acquired lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:16.681987 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Start _get_guest_xml network_info=[{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:16.682528 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-28a24646-fb46-4bb0-80ba-0ff5eb8f9981 req-f3535261-0225-4a39-ac51-ee7b91380cc6 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Refreshing network info cache for port b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:16.685209 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:16.686704 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-825501870', uuid='22e422c7-47a4-4619-92a8-b05b73989943'), owner=OwnerMeta(userid='e6e7f263d257406d8c7b8ab607d0e609', username='tempest-ServerStableDeviceRescueTest-382424917-project-member', projectid='92da496690954c8fb9c6eb722b956485', projectname='tempest-ServerStableDeviceRescueTest-382424917'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915676.6862702) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:16.690503 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:16.690503 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:16.690857 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:16.691038 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:16.692109 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:16.692523 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:16.692661 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:16.692875 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:16.692997 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:16.693094 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:16.693315 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:16.693977 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:16.694117 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:16.694615 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:16.694789 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:16.694954 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:16.702030 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk 1073741824" returned: 0 in 0.034s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:16.709876 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.124s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:16.709876 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:16.738296 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-825501870',display_name='tempest-ServerStableDeviceRescueTest-server-825501870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverstabledevicerescuetest-server-825501870',id=2,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGg1/9242vIbx6vjuoAaueOs/ycrtrXLSIRHl3kBo44NyGftUde+Q5/v9QeELCwC81jYOXCHSIshR3t5+UTnEBpZoHz1vAbfMO55j2RFIjE2iyvknOrzgj26SooPwTYUvA==',key_name='tempest-keypair-85036239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92da496690954c8fb9c6eb722b956485',ramdisk_id='',reservation_id='r-x4fpd3kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-382424917',owner_user_name='tempest-ServerStableDeviceRescueTest-382424917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e7f263d257406d8c7b8ab607d0e609',uuid=22e422c7-47a4-4619-92a8-b05b73989943,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:16.738549 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Converting VIF {"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:16.739744 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ec:22,bridge_name='br-int',has_traffic_filtering=True,id=b8698723-2577-4f03-aa99-ea06a904c148,network=Network(3506bf24-d962-44d8-ae8b-5f10ebe7fa2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8698723-25') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:16.740301 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'pci_devices' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:16.801280 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.087s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:16.801280 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:01:16.801280 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:16.813756 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: May 27 21:01:16.814887 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and May 27 21:01:16.814887 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. May 27 21:01:16.814887 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:16.814887 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different May 27 21:01:16.814887 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see May 27 21:01:16.814887 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html May 27 21:01:16.814887 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:16.814887 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher May 27 21:01:16.882679 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:16.884238 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Cannot resize image /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:01:16.884238 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:01:16.884238 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Ensure instance console log exists: /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:16.884238 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:16.884238 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:16.884238 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:16.931692 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:16.932536 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:16.934215 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:16.934537 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:17.033569 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:17.079740 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac9557e825354813ac31afa70f07ffc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251237411f6e4bb49303c88852d6e9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:17.141833 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: May 27 21:01:17.141985 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and May 27 21:01:17.141985 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. May 27 21:01:17.141985 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:17.142081 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different May 27 21:01:17.142081 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see May 27 21:01:17.142161 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html May 27 21:01:17.142161 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:17.142231 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) May 27 21:01:17.154505 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-520f8540-0933-404a-b744-ef3b44ad8d4e req-44b1d99c-d3a4-4d28-bfc2-cb35a39a13c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:17.185696 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-28a24646-fb46-4bb0-80ba-0ff5eb8f9981 req-f3535261-0225-4a39-ac51-ee7b91380cc6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:17.245006 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] End _get_guest_xml xml= May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 22e422c7-47a4-4619-92a8-b05b73989943 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: instance-00000002 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 196608 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 1 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: tempest-ServerStableDeviceRescueTest-server-825501870 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 2026-05-27 21:01:16 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 192 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 1 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 0 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 0 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 1 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: True May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: bare May 27 21:01:17.245006 np0000001553 nova-compute[98213]: qcow2 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 1 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 0 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: virtio May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: tempest-ServerStableDeviceRescueTest-382424917-project-member May 27 21:01:17.245006 np0000001553 nova-compute[98213]: tempest-ServerStableDeviceRescueTest-382424917 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:17.245006 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 22e422c7-47a4-4619-92a8-b05b73989943 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 22e422c7-47a4-4619-92a8-b05b73989943 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: hvm May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 128 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: 1 May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: May 27 21:01:17.245006 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:17.247716 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Preparing to wait for external event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:17.247716 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:17.247716 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:17.247716 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:17.247716 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-825501870',display_name='tempest-ServerStableDeviceRescueTest-server-825501870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverstabledevicerescuetest-server-825501870',id=2,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGg1/9242vIbx6vjuoAaueOs/ycrtrXLSIRHl3kBo44NyGftUde+Q5/v9QeELCwC81jYOXCHSIshR3t5+UTnEBpZoHz1vAbfMO55j2RFIjE2iyvknOrzgj26SooPwTYUvA==',key_name='tempest-keypair-85036239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92da496690954c8fb9c6eb722b956485',ramdisk_id='',reservation_id='r-x4fpd3kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-382424917',owner_user_name='tempest-ServerStableDeviceRescueTest-382424917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e7f263d257406d8c7b8ab607d0e609',uuid=22e422c7-47a4-4619-92a8-b05b73989943,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:17.248055 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Converting VIF {"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:17.248055 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ec:22,bridge_name='br-int',has_traffic_filtering=True,id=b8698723-2577-4f03-aa99-ea06a904c148,network=Network(3506bf24-d962-44d8-ae8b-5f10ebe7fa2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8698723-25') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:17.248055 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ec:22,bridge_name='br-int',has_traffic_filtering=True,id=b8698723-2577-4f03-aa99-ea06a904c148,network=Network(3506bf24-d962-44d8-ae8b-5f10ebe7fa2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8698723-25') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:17.248055 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:17.249115 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:17.249115 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:17.249887 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:17.250153 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '343ea5fe-7375-5cdd-ae99-182704a56805', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:17.258091 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:17.259880 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:17.401066 np0000001553 sudo[109908]: pam_unix(sudo:session): session closed for user root May 27 21:01:17.402822 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Spawned new privsep daemon via rootwrap May 27 21:01:17.404064 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [-] privsep daemon starting May 27 21:01:17.404160 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 May 27 21:01:17.404201 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none May 27 21:01:17.404282 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109933 May 27 21:01:17.405243 np0000001553 nova-compute[98213]: WARNING oslo_privsep.priv_context [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] privsep daemon already running May 27 21:01:17.437358 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:01:17.567668 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Successfully created port: 032fe0ad-2162-4bfc-9da0-bfa5f662aca9 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:17.602008 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:17.687033 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:17.687282 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8698723-25, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:17.687698 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8698723-25, col_values=(('qos', UUID('b0c3bd95-b4fd-4a24-9e9e-a09d2b4bda63')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:17.689184 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8698723-25, col_values=(('external_ids', {'iface-id': 'b8698723-2577-4f03-aa99-ea06a904c148', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:ec:22', 'vm-uuid': '22e422c7-47a4-4619-92a8-b05b73989943'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:17.692866 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-520f8540-0933-404a-b744-ef3b44ad8d4e req-44b1d99c-d3a4-4d28-bfc2-cb35a39a13c6 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Updated VIF entry in instance network info cache for port be1aa92c-fc86-4acd-8cae-2a0feb29f6df. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:17.693472 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-520f8540-0933-404a-b744-ef3b44ad8d4e req-44b1d99c-d3a4-4d28-bfc2-cb35a39a13c6 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Updating instance_info_cache with network_info: [{"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:17.698696 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:17.699657 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:17.700061 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe1aa92c-fc, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:17.700229 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe1aa92c-fc, col_values=(('qos', UUID('046b781a-c787-49b6-8027-bd3f5158f1f7')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:17.700377 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe1aa92c-fc, col_values=(('external_ids', {'iface-id': 'be1aa92c-fc86-4acd-8cae-2a0feb29f6df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:e8:b3', 'vm-uuid': 'f4397c41-4087-4367-b1ac-46e8cc475772'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:17.701289 np0000001553 nova-compute[98213]: INFO os_vif [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ec:22,bridge_name='br-int',has_traffic_filtering=True,id=b8698723-2577-4f03-aa99-ea06a904c148,network=Network(3506bf24-d962-44d8-ae8b-5f10ebe7fa2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8698723-25') May 27 21:01:17.711882 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:17.718031 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:17.724673 np0000001553 nova-compute[98213]: INFO os_vif [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:b3,bridge_name='br-int',has_traffic_filtering=True,id=be1aa92c-fc86-4acd-8cae-2a0feb29f6df,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe1aa92c-fc') May 27 21:01:17.940090 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:17.945741 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:17.945965 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:18.009065 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Updating instance_info_cache with network_info: [{"id": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "address": "fa:16:3e:e5:70:25", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44654d4f-25", "ovs_interfaceid": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:18.210036 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-520f8540-0933-404a-b744-ef3b44ad8d4e req-44b1d99c-d3a4-4d28-bfc2-cb35a39a13c6 service nova] Releasing lock "refresh_cache-f4397c41-4087-4367-b1ac-46e8cc475772" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:18.275543 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:18.337835 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-28a24646-fb46-4bb0-80ba-0ff5eb8f9981 req-f3535261-0225-4a39-ac51-ee7b91380cc6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:18.445696 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Booting with volume a346f346-41a8-46af-b859-272aacc21f6b at /dev/vda May 27 21:01:18.448893 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:18.505015 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:01:18.505559 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp241_21ni/privsep.sock'] May 27 21:01:18.511635 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Releasing lock "refresh_cache-f0c8ea02-9725-47ed-b34b-13ea3552d09b" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:18.511877 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Instance network_info: |[{"id": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "address": "fa:16:3e:e5:70:25", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44654d4f-25", "ovs_interfaceid": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:18.512511 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5804d7e3-6c03-471e-9801-788e45669e0c req-9f026761-77c9-4601-8a6f-2e036c41b006 service nova] Acquired lock "refresh_cache-f0c8ea02-9725-47ed-b34b-13ea3552d09b" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:18.514648 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-5804d7e3-6c03-471e-9801-788e45669e0c req-9f026761-77c9-4601-8a6f-2e036c41b006 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Refreshing network info cache for port 44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:18.515056 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Start _get_guest_xml network_info=[{"id": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "address": "fa:16:3e:e5:70:25", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44654d4f-25", "ovs_interfaceid": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:18.515279 np0000001553 sudo[109957]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp241_21ni/privsep.sock May 27 21:01:18.516033 np0000001553 sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) May 27 21:01:18.517585 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:18.519941 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-2038742707', uuid='f0c8ea02-9725-47ed-b34b-13ea3552d09b'), owner=OwnerMeta(userid='99659c2947e743c899512883f5a85b0e', username='tempest-ServerActionsTestOtherA-113699651-project-member', projectid='b562b6a1ba2b4c3ab101af22f9d04713', projectname='tempest-ServerActionsTestOtherA-113699651'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "address": "fa:16:3e:e5:70:25", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44654d4f-25", "ovs_interfaceid": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915678.5196073) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:18.522598 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:18.523319 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:18.526622 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:18.526622 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:18.526622 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:18.526622 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:18.526622 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:18.526622 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:18.526622 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:18.526939 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:18.526939 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:18.527119 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:18.527652 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:18.527652 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:18.527652 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:18.527777 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:18.540325 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2038742707',display_name='tempest-ServerActionsTestOtherA-server-2038742707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serveractionstestothera-server-2038742707',id=3,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEInSa8JrI1dfU7W+wLBPp0KWlcMNw6TBf93sf5arFwnFDMTf+oJ7sbOGBI1G87lQprSsk546XKRK37v0D6J+U6P0PeE2dVv2emGZ8L1bvjaexP3+OSahzZ8++QAwEAX8w==',key_name='tempest-keypair-1977253916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b562b6a1ba2b4c3ab101af22f9d04713',ramdisk_id='',reservation_id='r-e1lft04l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-113699651',owner_user_name='tempest-ServerActionsTestOtherA-113699651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99659c2947e743c899512883f5a85b0e',uuid=f0c8ea02-9725-47ed-b34b-13ea3552d09b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "address": "fa:16:3e:e5:70:25", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44654d4f-25", "ovs_interfaceid": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:18.540534 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converting VIF {"id": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "address": "fa:16:3e:e5:70:25", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44654d4f-25", "ovs_interfaceid": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:18.540943 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:25,bridge_name='br-int',has_traffic_filtering=True,id=44654d4f-25e2-4002-9a7f-af6cf7cac43c,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44654d4f-25') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:18.541861 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lazy-loading 'pci_devices' on Instance uuid f0c8ea02-9725-47ed-b34b-13ea3552d09b {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:18.548870 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Successfully updated port: 032fe0ad-2162-4bfc-9da0-bfa5f662aca9 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:18.608330 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9561bd01-004a-4f1e-bfbd-b3181d23e532 req-66975cab-8af5-4076-ad8c-de947bcf8de6 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Received event network-changed-032fe0ad-2162-4bfc-9da0-bfa5f662aca9 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:18.608585 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9561bd01-004a-4f1e-bfbd-b3181d23e532 req-66975cab-8af5-4076-ad8c-de947bcf8de6 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Refreshing instance network info cache due to event network-changed-032fe0ad-2162-4bfc-9da0-bfa5f662aca9. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:18.608778 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9561bd01-004a-4f1e-bfbd-b3181d23e532 req-66975cab-8af5-4076-ad8c-de947bcf8de6 service nova] Acquiring lock "refresh_cache-1597a38f-a6a7-45bd-86ec-3938926c5cc8" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:18.608895 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9561bd01-004a-4f1e-bfbd-b3181d23e532 req-66975cab-8af5-4076-ad8c-de947bcf8de6 service nova] Acquired lock "refresh_cache-1597a38f-a6a7-45bd-86ec-3938926c5cc8" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:18.609048 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-9561bd01-004a-4f1e-bfbd-b3181d23e532 req-66975cab-8af5-4076-ad8c-de947bcf8de6 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Refreshing network info cache for port 032fe0ad-2162-4bfc-9da0-bfa5f662aca9 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:18.780850 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: May 27 21:01:18.780850 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and May 27 21:01:18.780850 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. May 27 21:01:18.780850 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:18.780850 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different May 27 21:01:18.780850 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see May 27 21:01:18.780850 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html May 27 21:01:18.780850 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:18.780850 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher May 27 21:01:18.783394 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-28a24646-fb46-4bb0-80ba-0ff5eb8f9981 req-f3535261-0225-4a39-ac51-ee7b91380cc6 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updated VIF entry in instance network info cache for port b8698723-2577-4f03-aa99-ea06a904c148. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:18.783670 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-28a24646-fb46-4bb0-80ba-0ff5eb8f9981 req-f3535261-0225-4a39-ac51-ee7b91380cc6 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updating instance_info_cache with network_info: [{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:18.958163 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.535s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:18.958937 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.574s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:18.959289 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:18.963932 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:18.964084 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Claim successful on node np0000001553 May 27 21:01:19.017726 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-5804d7e3-6c03-471e-9801-788e45669e0c req-9f026761-77c9-4601-8a6f-2e036c41b006 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:19.043849 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] End _get_guest_xml xml= May 27 21:01:19.043849 np0000001553 nova-compute[98213]: f0c8ea02-9725-47ed-b34b-13ea3552d09b May 27 21:01:19.043849 np0000001553 nova-compute[98213]: instance-00000003 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 196608 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 1 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-server-2038742707 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 2026-05-27 21:01:18 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 192 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 1 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 0 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 0 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 1 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: True May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: bare May 27 21:01:19.043849 np0000001553 nova-compute[98213]: qcow2 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 1 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 0 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: virtio May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-113699651-project-member May 27 21:01:19.043849 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-113699651 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:19.043849 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: f0c8ea02-9725-47ed-b34b-13ea3552d09b May 27 21:01:19.043849 np0000001553 nova-compute[98213]: f0c8ea02-9725-47ed-b34b-13ea3552d09b May 27 21:01:19.043849 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: hvm May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 128 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: 1 May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: May 27 21:01:19.043849 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:19.046748 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Preparing to wait for external event network-vif-plugged-44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:19.046748 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:19.046748 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:19.046748 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:19.047668 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2038742707',display_name='tempest-ServerActionsTestOtherA-server-2038742707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serveractionstestothera-server-2038742707',id=3,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEInSa8JrI1dfU7W+wLBPp0KWlcMNw6TBf93sf5arFwnFDMTf+oJ7sbOGBI1G87lQprSsk546XKRK37v0D6J+U6P0PeE2dVv2emGZ8L1bvjaexP3+OSahzZ8++QAwEAX8w==',key_name='tempest-keypair-1977253916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b562b6a1ba2b4c3ab101af22f9d04713',ramdisk_id='',reservation_id='r-e1lft04l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-113699651',owner_user_name='tempest-ServerActionsTestOtherA-113699651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99659c2947e743c899512883f5a85b0e',uuid=f0c8ea02-9725-47ed-b34b-13ea3552d09b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "address": "fa:16:3e:e5:70:25", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44654d4f-25", "ovs_interfaceid": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:19.047668 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converting VIF {"id": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "address": "fa:16:3e:e5:70:25", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44654d4f-25", "ovs_interfaceid": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:19.049643 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:25,bridge_name='br-int',has_traffic_filtering=True,id=44654d4f-25e2-4002-9a7f-af6cf7cac43c,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44654d4f-25') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:19.049643 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:25,bridge_name='br-int',has_traffic_filtering=True,id=44654d4f-25e2-4002-9a7f-af6cf7cac43c,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44654d4f-25') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:19.049794 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:19.050036 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:19.050961 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:19.051685 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:19.051851 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e740e6d2-6df9-5265-8c80-808a030ca952', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:19.052591 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "refresh_cache-1597a38f-a6a7-45bd-86ec-3938926c5cc8" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:19.053202 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:19.063498 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:19.066670 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:19.066861 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44654d4f-25, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:19.067168 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44654d4f-25, col_values=(('qos', UUID('7ec03a78-5c8d-49a2-9d51-de4aeba020ea')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:19.067312 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44654d4f-25, col_values=(('external_ids', {'iface-id': '44654d4f-25e2-4002-9a7f-af6cf7cac43c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:70:25', 'vm-uuid': 'f0c8ea02-9725-47ed-b34b-13ea3552d09b'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:19.073794 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:19.082295 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:19.085274 np0000001553 nova-compute[98213]: INFO os_vif [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:70:25,bridge_name='br-int',has_traffic_filtering=True,id=44654d4f-25e2-4002-9a7f-af6cf7cac43c,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44654d4f-25') May 27 21:01:19.110985 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-9561bd01-004a-4f1e-bfbd-b3181d23e532 req-66975cab-8af5-4076-ad8c-de947bcf8de6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:19.116768 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-72fc8fa6-d45d-4808-a921-d30ba8c2d682 req-44596958-07db-4180-b4bc-6677d78fdda4 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:19.117767 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72fc8fa6-d45d-4808-a921-d30ba8c2d682 req-44596958-07db-4180-b4bc-6677d78fdda4 service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:19.117767 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72fc8fa6-d45d-4808-a921-d30ba8c2d682 req-44596958-07db-4180-b4bc-6677d78fdda4 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:19.118072 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72fc8fa6-d45d-4808-a921-d30ba8c2d682 req-44596958-07db-4180-b4bc-6677d78fdda4 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:19.118357 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-72fc8fa6-d45d-4808-a921-d30ba8c2d682 req-44596958-07db-4180-b4bc-6677d78fdda4 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] No event matching network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 in dict_keys([('network-vif-plugged', 'b8698723-2577-4f03-aa99-ea06a904c148')]) {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} May 27 21:01:19.118513 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-72fc8fa6-d45d-4808-a921-d30ba8c2d682 req-44596958-07db-4180-b4bc-6677d78fdda4 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received unexpected event network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 for instance with vm_state building and task_state spawning. May 27 21:01:19.120979 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: May 27 21:01:19.120979 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and May 27 21:01:19.120979 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. May 27 21:01:19.120979 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:19.120979 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different May 27 21:01:19.120979 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see May 27 21:01:19.120979 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html May 27 21:01:19.120979 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: May 27 21:01:19.120979 np0000001553 nova-compute[98213]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) May 27 21:01:19.197015 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-9561bd01-004a-4f1e-bfbd-b3181d23e532 req-66975cab-8af5-4076-ad8c-de947bcf8de6 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:19.231701 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:19.232161 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:19.232161 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No VIF found with MAC fa:16:3e:6e:ec:22, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:19.235164 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Using config drive May 27 21:01:19.252195 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:19.252195 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:19.252195 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No VIF found with MAC fa:16:3e:04:e8:b3, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:19.252850 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Using config drive May 27 21:01:19.285988 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-28a24646-fb46-4bb0-80ba-0ff5eb8f9981 req-f3535261-0225-4a39-ac51-ee7b91380cc6 service nova] Releasing lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:19.394085 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-9561bd01-004a-4f1e-bfbd-b3181d23e532 req-66975cab-8af5-4076-ad8c-de947bcf8de6 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:19.429569 np0000001553 sudo[109957]: pam_unix(sudo:session): session closed for user root May 27 21:01:19.431045 np0000001553 nova-compute[98213]: INFO oslo.privsep.daemon [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Spawned new privsep daemon via rootwrap May 27 21:01:19.477719 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:19.477871 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:19.478115 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:19.479053 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:19.517372 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-5804d7e3-6c03-471e-9801-788e45669e0c req-9f026761-77c9-4601-8a6f-2e036c41b006 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:19.526108 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:01:19.527181 np0000001553 nova-compute[98213]: WARNING os_brick.initiator.connectors.nvmeof [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' May 27 21:01:19.551304 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:19.573363 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:01:19.573784 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:01:19.576243 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:19.576368 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:19.585393 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:01:19.586436 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49'] May 27 21:01:19.586588 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:01:19.587168 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:01:19.587168 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== get_connector_properties: return (1081ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:01:19.587168 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Updating existing volume attachment record: 86d9a726-d975-463f-b65c-0376993b36d4 {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:01:19.616692 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5781e414d7324bfcab1b49b294174048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018d84b86f0542529549fee42f6b2815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:19.623116 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:19.623116 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:19.740579 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:19.758725 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:19.784378 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-5804d7e3-6c03-471e-9801-788e45669e0c req-9f026761-77c9-4601-8a6f-2e036c41b006 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Updated VIF entry in instance network info cache for port 44654d4f-25e2-4002-9a7f-af6cf7cac43c. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:19.784751 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-5804d7e3-6c03-471e-9801-788e45669e0c req-9f026761-77c9-4601-8a6f-2e036c41b006 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Updating instance_info_cache with network_info: [{"id": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "address": "fa:16:3e:e5:70:25", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44654d4f-25", "ovs_interfaceid": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:19.900272 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9561bd01-004a-4f1e-bfbd-b3181d23e532 req-66975cab-8af5-4076-ad8c-de947bcf8de6 service nova] Releasing lock "refresh_cache-1597a38f-a6a7-45bd-86ec-3938926c5cc8" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:19.904541 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquired lock "refresh_cache-1597a38f-a6a7-45bd-86ec-3938926c5cc8" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:19.904851 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:19.981423 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names May 27 21:01:20.078734 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:20.122371 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Creating config drive at /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk.config May 27 21:01:20.128557 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:20.134262 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpljyrrms5 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:20.177411 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpljyrrms5" returned: 0 in 0.043s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:20.287326 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5804d7e3-6c03-471e-9801-788e45669e0c req-9f026761-77c9-4601-8a6f-2e036c41b006 service nova] Releasing lock "refresh_cache-f0c8ea02-9725-47ed-b34b-13ea3552d09b" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:20.328203 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Successfully created port: da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:20.468967 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:20.469257 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:20.486532 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:20.550244 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Creating config drive at /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.config May 27 21:01:20.554650 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzeuh_e9l {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:20.578479 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:20.591024 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzeuh_e9l" returned: 0 in 0.036s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:20.601621 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:20.601728 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:20.601826 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No VIF found with MAC fa:16:3e:e5:70:25, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:20.602342 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Using config drive May 27 21:01:20.644217 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:20.701832 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:20.708456 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:20.716312 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:20.806521 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:20.896884 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:20.925587 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:20.975377 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Successfully updated port: da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:20.975377 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:20.994527 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Updating instance_info_cache with network_info: [{"id": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "address": "fa:16:3e:94:fd:a2", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032fe0ad-21", "ovs_interfaceid": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:21.112154 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:21.272583 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:21.287810 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Creating config drive at /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk.config May 27 21:01:21.292726 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzuaxvc_f {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:21.305259 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:21.311837 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:21.343483 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzuaxvc_f" returned: 0 in 0.051s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:21.388216 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:21.481466 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "refresh_cache-95d3c2a3-6ad3-4458-8771-4f95b37ad16c" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:21.481593 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquired lock "refresh_cache-95d3c2a3-6ad3-4458-8771-4f95b37ad16c" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:21.481759 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:21.489370 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.529s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:21.489370 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.844s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:21.490277 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:21.502019 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:21.502019 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Claim successful on node np0000001553 May 27 21:01:21.507890 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Releasing lock "refresh_cache-1597a38f-a6a7-45bd-86ec-3938926c5cc8" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:21.507890 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Instance network_info: |[{"id": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "address": "fa:16:3e:94:fd:a2", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032fe0ad-21", "ovs_interfaceid": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:21.509206 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:21.510883 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:21.511855 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Creating image(s) May 27 21:01:21.513332 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "/opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:21.514315 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "/opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:21.515237 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "/opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:21.515846 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "c01af6c227605088eb907450abbf375657969f73" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:21.516428 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "c01af6c227605088eb907450abbf375657969f73" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:21.581663 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9e181469-5702-4876-a8e4-7f185054bf5a req-b3caae1f-07b9-4b3e-a8d2-4d566b395010 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:21.585734 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9e181469-5702-4876-a8e4-7f185054bf5a req-b3caae1f-07b9-4b3e-a8d2-4d566b395010 service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:21.585953 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9e181469-5702-4876-a8e4-7f185054bf5a req-b3caae1f-07b9-4b3e-a8d2-4d566b395010 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:21.586274 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9e181469-5702-4876-a8e4-7f185054bf5a req-b3caae1f-07b9-4b3e-a8d2-4d566b395010 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:21.586446 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9e181469-5702-4876-a8e4-7f185054bf5a req-b3caae1f-07b9-4b3e-a8d2-4d566b395010 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Processing event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:01:21.619062 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-f8db2abc-7fc0-4985-9adf-e76ae653248c req-150cbd7f-22d4-477d-bf04-753e3bb13f75 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received event network-changed-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:21.619062 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-f8db2abc-7fc0-4985-9adf-e76ae653248c req-150cbd7f-22d4-477d-bf04-753e3bb13f75 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Refreshing instance network info cache due to event network-changed-da9da3ce-b0fd-4658-8440-3096b21ff91d. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:21.619062 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-f8db2abc-7fc0-4985-9adf-e76ae653248c req-150cbd7f-22d4-477d-bf04-753e3bb13f75 service nova] Acquiring lock "refresh_cache-95d3c2a3-6ad3-4458-8771-4f95b37ad16c" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:21.649064 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:21.780184 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:21.780184 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:21.780184 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Creating image(s) May 27 21:01:21.780184 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Did not create local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} May 27 21:01:21.780184 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Ensure instance console log exists: /opt/stack/data/nova/instances/1597a38f-a6a7-45bd-86ec-3938926c5cc8/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:22.289987 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:22.289987 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:22.289987 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:22.289987 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Start _get_guest_xml network_info=[{"id": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "address": "fa:16:3e:94:fd:a2", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032fe0ad-21", "ovs_interfaceid": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a346f346-41a8-46af-b859-272aacc21f6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1597a38f-a6a7-45bd-86ec-3938926c5cc8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a346f346-41a8-46af-b859-272aacc21f6b', 'serial': 'a346f346-41a8-46af-b859-272aacc21f6b', 'multiattach': True}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '86d9a726-d975-463f-b65c-0376993b36d4', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:22.289987 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:22.292084 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1210509068', uuid='1597a38f-a6a7-45bd-86ec-3938926c5cc8'), owner=OwnerMeta(userid='ac9557e825354813ac31afa70f07ffc7', username='tempest-AttachVolumeMultiAttachTest-1088868426-project-member', projectid='251237411f6e4bb49303c88852d6e9a1', projectname='tempest-AttachVolumeMultiAttachTest-1088868426'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "address": "fa:16:3e:94:fd:a2", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032fe0ad-21", "ovs_interfaceid": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915681.7859902) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:22.292084 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:22.292084 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:22.292084 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:22.292084 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:22.292084 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:22.292084 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:22.292084 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:22.292084 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:22.292084 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connector [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Factory for ISCSI on None {{(pid=98213) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: held 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:01:22.293762 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a346f346-41a8-46af-b859-272aacc21f6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:01:22.294850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:01:22.294850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:01:22.294850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a346f346-41a8-46af-b859-272aacc21f6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:01:22.294850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:01:22.294850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:01:22.294850 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:01:22.294850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:01:22.294850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:01:22.294850 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:01:22.294850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:01:22.294850 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:22.294850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:01:22.294850 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:22.294850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b] added May 27 21:01:22.294850 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:01:22.296330 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:01:22.296330 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:01:22.296330 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:01:22.296330 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:01:22.296330 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b] added May 27 21:01:22.296330 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:01:22.296330 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:01:22.296330 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:01:22.296330 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:01:22.296330 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:01:22.296330 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:22.296330 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:22.296330 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:22.297660 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:22.297660 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:22.297660 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [-] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:22.297660 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] VM Started (Lifecycle Event) May 27 21:01:22.297660 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ed1db4cbd845c58073d5095c37c4e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b2253516a48a496af623e0264802a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:22.369286 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:22.512812 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:01:22.547534 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Updating instance_info_cache with network_info: [{"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:22.550040 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:22.562069 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:22.562457 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73.part --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:22.605426 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:01:22.615574 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:01:22.617724 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Instance spawned successfully. May 27 21:01:22.619101 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:01:22.624934 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:22.631586 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:22.631705 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] VM Paused (Lifecycle Event) May 27 21:01:22.659783 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73.part --force-share --output=json" returned: 0 in 0.096s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:22.659783 np0000001553 nova-compute[98213]: DEBUG nova.virt.images [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] 5e190bcd-e265-4587-9b9c-19c206da345e was qcow2, converting to raw {{(pid=98213) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} May 27 21:01:22.663730 np0000001553 nova-compute[98213]: DEBUG nova.privsep.utils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98213) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} May 27 21:01:22.663730 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73.part /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73.converted {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:22.795794 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Successfully created port: ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:22.827074 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73.part /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73.converted" returned: 0 in 0.166s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:22.834212 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73.converted --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:22.857941 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:01:22.861687 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.state = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:01:22.878603 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:01:22.878603 np0000001553 nova-compute[98213]: # END RECORD May 27 21:01:22.878603 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:22.886507 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.state = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:01:22.886507 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:01:22.886507 np0000001553 nova-compute[98213]: # END RECORD May 27 21:01:22.886507 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:22.895120 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:22.903622 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:22.908652 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. May 27 21:01:22.908652 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:01:22.908776 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. May 27 21:01:22.908776 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:01:22.910383 np0000001553 nova-compute[98213]: WARNING os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. May 27 21:01:22.910383 np0000001553 nova-compute[98213]: May 27 21:01:22.916889 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73.converted --force-share --output=json" returned: 0 in 0.082s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:22.917721 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. May 27 21:01:22.917721 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:01:22.917721 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. May 27 21:01:22.917721 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:01:22.917721 np0000001553 nova-compute[98213]: WARNING os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. May 27 21:01:22.917721 np0000001553 nova-compute[98213]: May 27 21:01:22.919531 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "c01af6c227605088eb907450abbf375657969f73" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.403s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:22.920573 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:22.924766 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:22.926063 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73 --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:23.014410 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73 --force-share --output=json" returned: 0 in 0.088s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:23.018601 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "c01af6c227605088eb907450abbf375657969f73" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:23.019151 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "c01af6c227605088eb907450abbf375657969f73" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:23.019699 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:23.026417 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:23.035901 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:23.036620 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73 --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:23.060789 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Releasing lock "refresh_cache-95d3c2a3-6ad3-4458-8771-4f95b37ad16c" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:23.061266 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Instance network_info: |[{"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:23.066318 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-f8db2abc-7fc0-4985-9adf-e76ae653248c req-150cbd7f-22d4-477d-bf04-753e3bb13f75 service nova] Acquired lock "refresh_cache-95d3c2a3-6ad3-4458-8771-4f95b37ad16c" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:23.066318 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-f8db2abc-7fc0-4985-9adf-e76ae653248c req-150cbd7f-22d4-477d-bf04-753e3bb13f75 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Refreshing network info cache for port da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:23.113523 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73 --force-share --output=json" returned: 0 in 0.077s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:23.114862 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73,backing_fmt=raw /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:23.140108 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:23.140502 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:23.143751 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:23.143918 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:23.144343 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:23.144544 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:23.144819 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:23.145094 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:23.149648 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:23.151031 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:23.164580 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73,backing_fmt=raw /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk 1073741824" returned: 0 in 0.050s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:23.165072 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "c01af6c227605088eb907450abbf375657969f73" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.146s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:23.165456 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73 --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:23.247459 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c01af6c227605088eb907450abbf375657969f73 --force-share --output=json" returned: 0 in 0.082s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:23.247852 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:01:23.248104 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:23.327714 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:23.328235 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Cannot resize image /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:01:23.332156 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:01:23.332156 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Ensure instance console log exists: /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:23.332156 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:23.332156 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:23.332156 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:23.332156 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Start _get_guest_xml network_info=[{"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T21:01:05Z,direct_url=,disk_format='qcow2',id=5e190bcd-e265-4587-9b9c-19c206da345e,min_disk=0,min_ram=0,name='',owner='6193f22d65fd44099f7a17e58431ad00',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T21:01:08Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'disk_bus': 'scsi', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/sda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '5e190bcd-e265-4587-9b9c-19c206da345e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:23.336157 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:23.336157 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='5e190bcd-e265-4587-9b9c-19c206da345e', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-784414459', uuid='95d3c2a3-6ad3-4458-8771-4f95b37ad16c'), owner=OwnerMeta(userid='5781e414d7324bfcab1b49b294174048', username='tempest-AttachSCSIVolumeTestJSON-802568575-project-member', projectid='018d84b86f0542529549fee42f6b2815', projectname='tempest-AttachSCSIVolumeTestJSON-802568575'), image=ImageMeta(id='5e190bcd-e265-4587-9b9c-19c206da345e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915683.3339996) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:23.336157 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:23.336157 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:23.336157 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:23.336157 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:23.337001 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:23.337318 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T21:01:05Z,direct_url=,disk_format='qcow2',id=5e190bcd-e265-4587-9b9c-19c206da345e,min_disk=0,min_ram=0,name='',owner='6193f22d65fd44099f7a17e58431ad00',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T21:01:08Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:23.337451 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:23.337544 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:23.337655 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:23.337805 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:23.337852 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:23.337999 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:23.338091 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:23.338231 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:23.338331 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:23.338456 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:23.348457 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-784414459',display_name='tempest-AttachSCSIVolumeTestJSON-server-784414459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-attachscsivolumetestjson-server-784414459',id=5,image_ref='5e190bcd-e265-4587-9b9c-19c206da345e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe1GalP+gY/jzcdebDoXADuRBq4cg069T8lFla8oIGt7yhYXPMkeNrN6zb0OLYUOMOFMn6P9RTZ3qJxTZPf4T9/DidK0caJhxHWhPGxpI3gxFTfgAc08JdIz8LVKMO3Eg==',key_name='tempest-keypair-1085935183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='018d84b86f0542529549fee42f6b2815',ramdisk_id='',reservation_id='r-e9u8tr5h',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5e190bcd-e265-4587-9b9c-19c206da345e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-802568575',owner_user_name='tempest-AttachSCSIVolumeTestJSON-802568575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5781e414d7324bfcab1b49b294174048',uuid=95d3c2a3-6ad3-4458-8771-4f95b37ad16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:23.348665 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Converting VIF {"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:23.349259 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:28:ab,bridge_name='br-int',has_traffic_filtering=True,id=da9da3ce-b0fd-4658-8440-3096b21ff91d,network=Network(4253b50e-7358-4db7-be07-3aabc5ffa250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9da3ce-b0') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:23.349766 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lazy-loading 'pci_devices' on Instance uuid 95d3c2a3-6ad3-4458-8771-4f95b37ad16c {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:23.427442 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Successfully updated port: ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:23.498489 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-dce48952-8fd6-46eb-b0db-4bd2ff96c2c7 req-8d0f7d5c-488a-4820-baa5-1997e211ce8f service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received event network-changed-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:23.498898 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-dce48952-8fd6-46eb-b0db-4bd2ff96c2c7 req-8d0f7d5c-488a-4820-baa5-1997e211ce8f service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Refreshing instance network info cache due to event network-changed-ac7f24ac-e29a-4ba6-b014-76d87fea9c22. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:23.499089 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-dce48952-8fd6-46eb-b0db-4bd2ff96c2c7 req-8d0f7d5c-488a-4820-baa5-1997e211ce8f service nova] Acquiring lock "refresh_cache-69083572-b3e6-403a-ae54-6f128a2c88f9" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:23.499227 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-dce48952-8fd6-46eb-b0db-4bd2ff96c2c7 req-8d0f7d5c-488a-4820-baa5-1997e211ce8f service nova] Acquired lock "refresh_cache-69083572-b3e6-403a-ae54-6f128a2c88f9" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:23.499375 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-dce48952-8fd6-46eb-b0db-4bd2ff96c2c7 req-8d0f7d5c-488a-4820-baa5-1997e211ce8f service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Refreshing network info cache for port ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:23.571711 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-f8db2abc-7fc0-4985-9adf-e76ae653248c req-150cbd7f-22d4-477d-bf04-753e3bb13f75 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:23.647443 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-07a1fc7b-0504-4466-8c56-049d71f8f239 req-a9ea519a-3d80-4c31-9b77-1fc4f6333d1a service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:23.648418 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-07a1fc7b-0504-4466-8c56-049d71f8f239 req-a9ea519a-3d80-4c31-9b77-1fc4f6333d1a service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:23.649183 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-07a1fc7b-0504-4466-8c56-049d71f8f239 req-a9ea519a-3d80-4c31-9b77-1fc4f6333d1a service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:23.649183 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-07a1fc7b-0504-4466-8c56-049d71f8f239 req-a9ea519a-3d80-4c31-9b77-1fc4f6333d1a service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:23.649183 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-07a1fc7b-0504-4466-8c56-049d71f8f239 req-a9ea519a-3d80-4c31-9b77-1fc4f6333d1a service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] No waiting events found dispatching network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:23.649390 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-07a1fc7b-0504-4466-8c56-049d71f8f239 req-a9ea519a-3d80-4c31-9b77-1fc4f6333d1a service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received unexpected event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 for instance with vm_state building and task_state spawning. May 27 21:01:23.650744 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:23.659027 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:01:23.659630 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:23.663730 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] VM Started (Lifecycle Event) May 27 21:01:23.668782 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Took 9.54 seconds to spawn the instance on the hypervisor. May 27 21:01:23.669275 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:23.699043 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:23.710444 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:23.727431 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:23.853040 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] End _get_guest_xml xml= May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c May 27 21:01:23.853040 np0000001553 nova-compute[98213]: instance-00000005 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 196608 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 1 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: tempest-AttachSCSIVolumeTestJSON-server-784414459 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 2026-05-27 21:01:23 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 192 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 1 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 0 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 0 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 1 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: True May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: bare May 27 21:01:23.853040 np0000001553 nova-compute[98213]: qcow2 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 1 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 0 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: scsi May 27 21:01:23.853040 np0000001553 nova-compute[98213]: scsi May 27 21:01:23.853040 np0000001553 nova-compute[98213]: virtio-scsi May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: tempest-AttachSCSIVolumeTestJSON-802568575-project-member May 27 21:01:23.853040 np0000001553 nova-compute[98213]: tempest-AttachSCSIVolumeTestJSON-802568575 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:23.853040 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c May 27 21:01:23.853040 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: hvm May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 128 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: 1 May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]:
May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]:
May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: May 27 21:01:23.853040 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:23.855054 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Preparing to wait for external event network-vif-plugged-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:23.855054 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:23.855054 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:23.855054 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:23.855054 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-784414459',display_name='tempest-AttachSCSIVolumeTestJSON-server-784414459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-attachscsivolumetestjson-server-784414459',id=5,image_ref='5e190bcd-e265-4587-9b9c-19c206da345e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe1GalP+gY/jzcdebDoXADuRBq4cg069T8lFla8oIGt7yhYXPMkeNrN6zb0OLYUOMOFMn6P9RTZ3qJxTZPf4T9/DidK0caJhxHWhPGxpI3gxFTfgAc08JdIz8LVKMO3Eg==',key_name='tempest-keypair-1085935183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='018d84b86f0542529549fee42f6b2815',ramdisk_id='',reservation_id='r-e9u8tr5h',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5e190bcd-e265-4587-9b9c-19c206da345e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-802568575',owner_user_name='tempest-AttachSCSIVolumeTestJSON-802568575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5781e414d7324bfcab1b49b294174048',uuid=95d3c2a3-6ad3-4458-8771-4f95b37ad16c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:23.855304 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Converting VIF {"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:23.855851 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:28:ab,bridge_name='br-int',has_traffic_filtering=True,id=da9da3ce-b0fd-4658-8440-3096b21ff91d,network=Network(4253b50e-7358-4db7-be07-3aabc5ffa250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9da3ce-b0') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:23.855961 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:28:ab,bridge_name='br-int',has_traffic_filtering=True,id=da9da3ce-b0fd-4658-8440-3096b21ff91d,network=Network(4253b50e-7358-4db7-be07-3aabc5ffa250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9da3ce-b0') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:23.856415 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:23.856813 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:23.857028 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:23.857792 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:23.857969 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '927d8d40-f655-5c58-934d-bfbb837bf395', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:23.858699 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:23.859280 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:23.859878 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:23.862045 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:23.862202 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda9da3ce-b0, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:23.862503 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda9da3ce-b0, col_values=(('qos', UUID('b6df110e-ac47-4418-bf5a-9ba48b7b76b9')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:23.862648 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda9da3ce-b0, col_values=(('external_ids', {'iface-id': 'da9da3ce-b0fd-4658-8440-3096b21ff91d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:28:ab', 'vm-uuid': '95d3c2a3-6ad3-4458-8771-4f95b37ad16c'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:23.863633 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:23.865103 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:23.871172 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:23.871172 np0000001553 nova-compute[98213]: INFO os_vif [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:28:ab,bridge_name='br-int',has_traffic_filtering=True,id=da9da3ce-b0fd-4658-8440-3096b21ff91d,network=Network(4253b50e-7358-4db7-be07-3aabc5ffa250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9da3ce-b0') May 27 21:01:23.932412 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquiring lock "refresh_cache-69083572-b3e6-403a-ae54-6f128a2c88f9" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:23.952296 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b, portal: 192.168.40.100,3260] May 27 21:01:23.952296 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b, portal: 192.168.40.100,3260] successful. May 27 21:01:23.952296 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:23.952855 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b, portal: 192.168.50.100,3260] May 27 21:01:23.952855 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b, portal: 192.168.50.100,3260] successful. May 27 21:01:23.952855 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:23.962480 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:23.968182 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:23.975993 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:23.975993 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:23.975993 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:01:23.976239 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:23.976239 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:23.976239 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:01:23.976716 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.148s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:01:23.976896 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:01:23.978100 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:01:23.978272 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:01:23.983580 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:23.983580 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:23.983580 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:01:23.983580 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:23.983580 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:23.983580 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:01:23.983580 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.149s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:01:23.983580 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:01:23.983580 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:01:23.983580 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:01:24.002305 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:01:24.002305 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a346f346-41a8-46af-b859-272aacc21f6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:01:24.005136 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-dce48952-8fd6-46eb-b0db-4bd2ff96c2c7 req-8d0f7d5c-488a-4820-baa5-1997e211ce8f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:24.007930 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:01:24.007930 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a346f346-41a8-46af-b859-272aacc21f6b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:01:24.052371 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:24.053341 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:24.053579 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Creating image(s) May 27 21:01:24.053988 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquiring lock "/opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:24.054340 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "/opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:24.056848 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "/opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:24.057472 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:24.060002 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:24.061049 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:24.162474 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.674s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:24.168366 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-dce48952-8fd6-46eb-b0db-4bd2ff96c2c7 req-8d0f7d5c-488a-4820-baa5-1997e211ce8f service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:24.174274 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:24.186996 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.458s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:24.193387 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:24.193835 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.123s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:24.198575 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:24.206485 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Took 14.97 seconds to build instance. May 27 21:01:24.207332 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.009s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:24.208604 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:24.227978 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:24.228197 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:24.228723 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:24.253241 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:24.262847 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Claim successful on node np0000001553 May 27 21:01:24.333727 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.105s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:24.335941 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:24.373313 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk 1073741824" returned: 0 in 0.037s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:24.373313 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.165s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:24.373313 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:24.450987 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.078s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:24.452602 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:01:24.452693 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:24.478035 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-dce48952-8fd6-46eb-b0db-4bd2ff96c2c7 req-8d0f7d5c-488a-4820-baa5-1997e211ce8f service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:24.519673 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:24.521268 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Cannot resize image /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:01:24.521268 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:01:24.521268 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Ensure instance console log exists: /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:24.521268 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:24.521268 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:24.521268 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:24.531020 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-f8db2abc-7fc0-4985-9adf-e76ae653248c req-150cbd7f-22d4-477d-bf04-753e3bb13f75 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:24.544134 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:24.551521 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:24.571729 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:24.577077 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:24.674569 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-f8db2abc-7fc0-4985-9adf-e76ae653248c req-150cbd7f-22d4-477d-bf04-753e3bb13f75 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Updated VIF entry in instance network info cache for port da9da3ce-b0fd-4658-8440-3096b21ff91d. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:24.674569 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-f8db2abc-7fc0-4985-9adf-e76ae653248c req-150cbd7f-22d4-477d-bf04-753e3bb13f75 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Updating instance_info_cache with network_info: [{"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:24.710047 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:24.711504 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:24.713181 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:24.713181 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:24.728460 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7b859197-1b05-4bd4-8975-c05e8a62c958 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.500s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:24.777162 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:24.777162 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] VM Paused (Lifecycle Event) May 27 21:01:24.803671 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ef4507fea674555a32ee8d5a982e7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0d658b24414d8aadb0cb04849300a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:24.835066 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:01:24.982489 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-dce48952-8fd6-46eb-b0db-4bd2ff96c2c7 req-8d0f7d5c-488a-4820-baa5-1997e211ce8f service nova] Releasing lock "refresh_cache-69083572-b3e6-403a-ae54-6f128a2c88f9" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:24.984236 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquired lock "refresh_cache-69083572-b3e6-403a-ae54-6f128a2c88f9" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:24.984236 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:25.011776 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:25.015488 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:25.018587 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:25.039082 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:25.041536 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:25.179244 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-f8db2abc-7fc0-4985-9adf-e76ae653248c req-150cbd7f-22d4-477d-bf04-753e3bb13f75 service nova] Releasing lock "refresh_cache-95d3c2a3-6ad3-4458-8771-4f95b37ad16c" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:25.212358 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:01:25.281602 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:25.282796 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:25.282882 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] VM Resumed (Lifecycle Event) May 27 21:01:25.399869 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] No BDM found with device name sda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:25.399869 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:25.399869 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] No VIF found with MAC fa:16:3e:82:28:ab, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:25.401008 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Using config drive May 27 21:01:25.433564 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Successfully created port: d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:25.706643 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:25.715667 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:25.796272 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:25.796487 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:25.803639 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:25.805152 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:25.856523 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Found WWN 330000000e2143f96 for multipath device dm-0 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:01:25.857007 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.042s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:01:25.857640 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== connect_volume: return (4043ms) {'type': 'block', 'scsi_wwn': '330000000e2143f96', 'path': '/dev/dm-0', 'multipath_id': '330000000e2143f96'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:01:25.857838 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e2143f96', 'path': '/dev/dm-0', 'multipath_id': '330000000e2143f96'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:01:25.910700 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:25.917385 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-bfe70ae0-e9d7-4179-8a96-eb68d038d343 req-2b9426ac-6b05-4a99-8ab9-f2e23fee7b5b service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received event network-vif-unplugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:25.917648 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-bfe70ae0-e9d7-4179-8a96-eb68d038d343 req-2b9426ac-6b05-4a99-8ab9-f2e23fee7b5b service nova] Acquiring lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:25.918240 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-bfe70ae0-e9d7-4179-8a96-eb68d038d343 req-2b9426ac-6b05-4a99-8ab9-f2e23fee7b5b service nova] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:25.918476 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-bfe70ae0-e9d7-4179-8a96-eb68d038d343 req-2b9426ac-6b05-4a99-8ab9-f2e23fee7b5b service nova] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:25.918683 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-bfe70ae0-e9d7-4179-8a96-eb68d038d343 req-2b9426ac-6b05-4a99-8ab9-f2e23fee7b5b service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] No event matching network-vif-unplugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df in dict_keys([('network-vif-plugged', 'be1aa92c-fc86-4acd-8cae-2a0feb29f6df')]) {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} May 27 21:01:25.918866 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-bfe70ae0-e9d7-4179-8a96-eb68d038d343 req-2b9426ac-6b05-4a99-8ab9-f2e23fee7b5b service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received unexpected event network-vif-unplugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df for instance with vm_state building and task_state spawning. May 27 21:01:26.072422 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Successfully updated port: d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:26.179512 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6a69ab1f-ea26-462e-adc6-d81759f9b43f req-9ffe61e2-a50f-459f-91df-97b247d4b9ee service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-changed-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:26.180675 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6a69ab1f-ea26-462e-adc6-d81759f9b43f req-9ffe61e2-a50f-459f-91df-97b247d4b9ee service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Refreshing instance network info cache due to event network-changed-b8698723-2577-4f03-aa99-ea06a904c148. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:26.180867 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6a69ab1f-ea26-462e-adc6-d81759f9b43f req-9ffe61e2-a50f-459f-91df-97b247d4b9ee service nova] Acquiring lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:26.180993 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6a69ab1f-ea26-462e-adc6-d81759f9b43f req-9ffe61e2-a50f-459f-91df-97b247d4b9ee service nova] Acquired lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:26.181168 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-6a69ab1f-ea26-462e-adc6-d81759f9b43f req-9ffe61e2-a50f-459f-91df-97b247d4b9ee service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Refreshing network info cache for port b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:26.217101 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-2af20bb5-35ec-468a-866f-0ae373db3079 req-ce918a9d-d045-4f1c-930d-880e12142d3e service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Received event network-changed-d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:26.217619 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-2af20bb5-35ec-468a-866f-0ae373db3079 req-ce918a9d-d045-4f1c-930d-880e12142d3e service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Refreshing instance network info cache due to event network-changed-d60a0341-d711-4a9b-83bb-cad3bf479f30. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:26.218940 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-2af20bb5-35ec-468a-866f-0ae373db3079 req-ce918a9d-d045-4f1c-930d-880e12142d3e service nova] Acquiring lock "refresh_cache-aac9c5e0-da16-44ef-b255-53b21d0cc63d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:26.219541 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-2af20bb5-35ec-468a-866f-0ae373db3079 req-ce918a9d-d045-4f1c-930d-880e12142d3e service nova] Acquired lock "refresh_cache-aac9c5e0-da16-44ef-b255-53b21d0cc63d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:26.219939 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-2af20bb5-35ec-468a-866f-0ae373db3079 req-ce918a9d-d045-4f1c-930d-880e12142d3e service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Refreshing network info cache for port d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:26.251999 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Creating config drive at /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk.config May 27 21:01:26.258342 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_h025bsx {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:26.273475 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:26.293714 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_h025bsx" returned: 0 in 0.036s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:26.299048 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:26.308874 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:26.309011 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] VM Started (Lifecycle Event) May 27 21:01:26.367638 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1210509068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-attachvolumemultiattachtest-server-1210509068',id=4,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-2hb0q2zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:18Z,user_data=None,user_id='ac9557e825354813ac31afa70f07ffc7',uuid=1597a38f-a6a7-45bd-86ec-3938926c5cc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "address": "fa:16:3e:94:fd:a2", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032fe0ad-21", "ovs_interfaceid": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:26.367906 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "address": "fa:16:3e:94:fd:a2", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032fe0ad-21", "ovs_interfaceid": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:26.368805 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:fd:a2,bridge_name='br-int',has_traffic_filtering=True,id=032fe0ad-2162-4bfc-9da0-bfa5f662aca9,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032fe0ad-21') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:26.369998 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'pci_devices' on Instance uuid 1597a38f-a6a7-45bd-86ec-3938926c5cc8 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:26.438918 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Updating instance_info_cache with network_info: [{"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:26.571258 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "refresh_cache-aac9c5e0-da16-44ef-b255-53b21d0cc63d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:26.650503 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:26.690672 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-6a69ab1f-ea26-462e-adc6-d81759f9b43f req-9ffe61e2-a50f-459f-91df-97b247d4b9ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:26.695195 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:26.719041 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:26.727181 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-2af20bb5-35ec-468a-866f-0ae373db3079 req-ce918a9d-d045-4f1c-930d-880e12142d3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:26.730130 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:26.731589 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:26.731794 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Creating image(s) May 27 21:01:26.732589 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "/opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:26.732747 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "/opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:26.733598 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "/opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:26.734037 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:26.738536 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:26.738848 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:26.802721 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.064s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:26.803085 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:26.803574 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:26.803948 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:26.806588 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:26.806850 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:26.824607 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.657s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:26.827050 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:26.830808 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:26.834211 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:26.836708 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-2af20bb5-35ec-468a-866f-0ae373db3079 req-ce918a9d-d045-4f1c-930d-880e12142d3e service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:26.840998 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:26.841094 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] VM Paused (Lifecycle Event) May 27 21:01:26.873238 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] End _get_guest_xml xml= May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 1597a38f-a6a7-45bd-86ec-3938926c5cc8 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: instance-00000004 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 196608 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 1 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-server-1210509068 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 2026-05-27 21:01:21 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 192 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 1 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 0 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 0 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 1 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: True May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 1 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 0 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: virtio May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426-project-member May 27 21:01:26.873238 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:26.873238 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 1597a38f-a6a7-45bd-86ec-3938926c5cc8 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 1597a38f-a6a7-45bd-86ec-3938926c5cc8 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: hvm May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 128 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: 1 May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: a346f346-41a8-46af-b859-272aacc21f6b May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: May 27 21:01:26.873238 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:26.875200 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Preparing to wait for external event network-vif-plugged-032fe0ad-2162-4bfc-9da0-bfa5f662aca9 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:26.875200 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:26.875200 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:26.875200 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:26.875200 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1210509068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-attachvolumemultiattachtest-server-1210509068',id=4,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-2hb0q2zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:18Z,user_data=None,user_id='ac9557e825354813ac31afa70f07ffc7',uuid=1597a38f-a6a7-45bd-86ec-3938926c5cc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "address": "fa:16:3e:94:fd:a2", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032fe0ad-21", "ovs_interfaceid": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:26.875511 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "address": "fa:16:3e:94:fd:a2", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap032fe0ad-21", "ovs_interfaceid": "032fe0ad-2162-4bfc-9da0-bfa5f662aca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:26.875511 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:fd:a2,bridge_name='br-int',has_traffic_filtering=True,id=032fe0ad-2162-4bfc-9da0-bfa5f662aca9,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032fe0ad-21') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:26.875776 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:fd:a2,bridge_name='br-int',has_traffic_filtering=True,id=032fe0ad-2162-4bfc-9da0-bfa5f662aca9,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032fe0ad-21') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:26.877802 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:26.878149 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:26.878787 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:26.879655 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:26.880204 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57a63148-ddf0-5761-9c5a-aa44e67aa491', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:26.883687 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:26.900796 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:26.901927 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:26.902610 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:26.902832 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap032fe0ad-21, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:26.903271 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap032fe0ad-21, col_values=(('qos', UUID('e090dbe7-2bd4-4d2f-8d43-33d5c5db0f5f')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:26.903496 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap032fe0ad-21, col_values=(('external_ids', {'iface-id': '032fe0ad-2162-4bfc-9da0-bfa5f662aca9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:fd:a2', 'vm-uuid': '1597a38f-a6a7-45bd-86ec-3938926c5cc8'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:26.922918 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:26.934127 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:26.934127 np0000001553 nova-compute[98213]: INFO os_vif [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:fd:a2,bridge_name='br-int',has_traffic_filtering=True,id=032fe0ad-2162-4bfc-9da0-bfa5f662aca9,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap032fe0ad-21') May 27 21:01:26.942862 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Releasing lock "refresh_cache-69083572-b3e6-403a-ae54-6f128a2c88f9" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:26.942970 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Instance network_info: |[{"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:26.945092 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Start _get_guest_xml network_info=[{"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:26.956763 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk 1073741824" returned: 0 in 0.055s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:26.957360 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.154s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:26.959155 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:26.970400 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:26.975380 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-814714645', uuid='69083572-b3e6-403a-ae54-6f128a2c88f9'), owner=OwnerMeta(userid='d7ed1db4cbd845c58073d5095c37c4e4', username='tempest-VolumesAssistedSnapshotsTest-30557332-project-member', projectid='071b2253516a48a496af623e0264802a', projectname='tempest-VolumesAssistedSnapshotsTest-30557332'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915686.9740953) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:26.978512 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:26.979408 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:26.984162 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:26.984162 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:26.984162 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:26.984162 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:26.984477 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:26.984477 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:26.984541 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:26.984605 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:26.984999 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:26.985215 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:26.985411 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:26.985580 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:26.985879 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:26.986050 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:27.004093 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-814714645',display_name='tempest-VolumesAssistedSnapshotsTest-server-814714645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-volumesassistedsnapshotstest-server-814714645',id=6,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4oJ0wFajYaTv/TdCwM/olvXNZFN8olbra3nVscAxsoNbva+GHlzmliQmUro9RnfdDLslzk6Nl6z/oQnjXzSVHiJ0NJkhxbnrGSLCHHVFuRxPEw4492/zc+xxn+IdhG9A==',key_name='tempest-keypair-1979148841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='071b2253516a48a496af623e0264802a',ramdisk_id='',reservation_id='r-v0lna0t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-30557332',owner_user_name='tempest-VolumesAssistedSnapshotsTest-30557332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ed1db4cbd845c58073d5095c37c4e4',uuid=69083572-b3e6-403a-ae54-6f128a2c88f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:27.004362 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Converting VIF {"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:27.005545 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:af:46,bridge_name='br-int',has_traffic_filtering=True,id=ac7f24ac-e29a-4ba6-b014-76d87fea9c22,network=Network(4db21723-c86f-4669-b10b-8c12757384f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f24ac-e2') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:27.006413 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lazy-loading 'pci_devices' on Instance uuid 69083572-b3e6-403a-ae54-6f128a2c88f9 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:27.033460 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.075s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:27.033460 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:01:27.033460 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:27.051687 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-2af20bb5-35ec-468a-866f-0ae373db3079 req-ce918a9d-d045-4f1c-930d-880e12142d3e service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:27.056293 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.080400 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.084217 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.113023 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:27.113497 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Cannot resize image /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:01:27.113879 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:01:27.114100 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Ensure instance console log exists: /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:27.114458 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:27.114727 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:27.114903 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:27.155508 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-6a69ab1f-ea26-462e-adc6-d81759f9b43f req-9ffe61e2-a50f-459f-91df-97b247d4b9ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:27.283683 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-6a69ab1f-ea26-462e-adc6-d81759f9b43f req-9ffe61e2-a50f-459f-91df-97b247d4b9ee service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updated VIF entry in instance network info cache for port b8698723-2577-4f03-aa99-ea06a904c148. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:27.284461 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-6a69ab1f-ea26-462e-adc6-d81759f9b43f req-9ffe61e2-a50f-459f-91df-97b247d4b9ee service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updating instance_info_cache with network_info: [{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:27.336201 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:27.336887 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:27.337215 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:27.337491 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:27.344185 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:27.347410 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:27.439916 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ef4507fea674555a32ee8d5a982e7d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0d658b24414d8aadb0cb04849300a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:27.513283 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] End _get_guest_xml xml= May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 69083572-b3e6-403a-ae54-6f128a2c88f9 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: instance-00000006 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 196608 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 1 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: tempest-VolumesAssistedSnapshotsTest-server-814714645 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 2026-05-27 21:01:26 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 192 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 1 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 0 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 0 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 1 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: True May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: bare May 27 21:01:27.513283 np0000001553 nova-compute[98213]: qcow2 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 1 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 0 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: virtio May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: tempest-VolumesAssistedSnapshotsTest-30557332-project-member May 27 21:01:27.513283 np0000001553 nova-compute[98213]: tempest-VolumesAssistedSnapshotsTest-30557332 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:27.513283 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 69083572-b3e6-403a-ae54-6f128a2c88f9 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 69083572-b3e6-403a-ae54-6f128a2c88f9 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: hvm May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 128 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: 1 May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: May 27 21:01:27.513283 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:27.514822 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Preparing to wait for external event network-vif-plugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:27.514822 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:27.514822 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:27.514822 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:27.516133 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-814714645',display_name='tempest-VolumesAssistedSnapshotsTest-server-814714645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-volumesassistedsnapshotstest-server-814714645',id=6,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4oJ0wFajYaTv/TdCwM/olvXNZFN8olbra3nVscAxsoNbva+GHlzmliQmUro9RnfdDLslzk6Nl6z/oQnjXzSVHiJ0NJkhxbnrGSLCHHVFuRxPEw4492/zc+xxn+IdhG9A==',key_name='tempest-keypair-1979148841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='071b2253516a48a496af623e0264802a',ramdisk_id='',reservation_id='r-v0lna0t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-30557332',owner_user_name='tempest-VolumesAssistedSnapshotsTest-30557332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ed1db4cbd845c58073d5095c37c4e4',uuid=69083572-b3e6-403a-ae54-6f128a2c88f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:27.516684 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Converting VIF {"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:27.517627 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:af:46,bridge_name='br-int',has_traffic_filtering=True,id=ac7f24ac-e29a-4ba6-b014-76d87fea9c22,network=Network(4db21723-c86f-4669-b10b-8c12757384f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f24ac-e2') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:27.518156 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:af:46,bridge_name='br-int',has_traffic_filtering=True,id=ac7f24ac-e29a-4ba6-b014-76d87fea9c22,network=Network(4db21723-c86f-4669-b10b-8c12757384f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f24ac-e2') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:27.518853 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.519079 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:27.519308 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:27.521546 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.521546 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '379e4dcf-5af6-55a1-a436-95266caa898f', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:27.522281 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.523983 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:27.527309 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.530646 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.530824 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac7f24ac-e2, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:27.531150 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac7f24ac-e2, col_values=(('qos', UUID('1b5f78a4-8888-426e-85a9-f2eb264ba426')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:27.531335 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac7f24ac-e2, col_values=(('external_ids', {'iface-id': 'ac7f24ac-e29a-4ba6-b014-76d87fea9c22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:af:46', 'vm-uuid': '69083572-b3e6-403a-ae54-6f128a2c88f9'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:27.532186 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.533285 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:27.545103 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.546051 np0000001553 nova-compute[98213]: INFO os_vif [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:af:46,bridge_name='br-int',has_traffic_filtering=True,id=ac7f24ac-e29a-4ba6-b014-76d87fea9c22,network=Network(4db21723-c86f-4669-b10b-8c12757384f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f24ac-e2') May 27 21:01:27.557917 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-2af20bb5-35ec-468a-866f-0ae373db3079 req-ce918a9d-d045-4f1c-930d-880e12142d3e service nova] Releasing lock "refresh_cache-aac9c5e0-da16-44ef-b255-53b21d0cc63d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:27.558877 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquired lock "refresh_cache-aac9c5e0-da16-44ef-b255-53b21d0cc63d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:27.559284 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:27.737879 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:27.785654 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6a69ab1f-ea26-462e-adc6-d81759f9b43f req-9ffe61e2-a50f-459f-91df-97b247d4b9ee service nova] Releasing lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:27.844012 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:01:27.854282 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Successfully created port: f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:27.854488 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:01:27.854812 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:27.854922 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] VM Started (Lifecycle Event) May 27 21:01:27.995210 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received event network-vif-unplugged-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:27.995917 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:27.996114 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:27.996299 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:27.996505 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] No event matching network-vif-unplugged-da9da3ce-b0fd-4658-8440-3096b21ff91d in dict_keys([('network-vif-plugged', 'da9da3ce-b0fd-4658-8440-3096b21ff91d')]) {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} May 27 21:01:27.996685 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received unexpected event network-vif-unplugged-da9da3ce-b0fd-4658-8440-3096b21ff91d for instance with vm_state building and task_state spawning. May 27 21:01:27.996868 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received event network-vif-plugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:27.997043 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Acquiring lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:27.997217 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:27.997348 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:27.997527 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Processing event network-vif-plugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:01:27.997726 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received event network-vif-plugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:27.997909 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Acquiring lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:27.998301 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:27.998301 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:27.998475 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] No waiting events found dispatching network-vif-plugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:27.998652 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received unexpected event network-vif-plugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df for instance with vm_state building and task_state spawning. May 27 21:01:27.999301 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received event network-vif-unplugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:27.999650 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:01:27.999920 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:28.000097 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:28.000430 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:28.000430 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] No event matching network-vif-unplugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 in dict_keys([('network-vif-plugged', 'ac7f24ac-e29a-4ba6-b014-76d87fea9c22')]) {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} May 27 21:01:28.000716 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received unexpected event network-vif-unplugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 for instance with vm_state building and task_state spawning. May 27 21:01:28.000780 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received event network-vif-plugged-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:28.000941 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:28.001179 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:28.001274 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:28.001435 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Processing event network-vif-plugged-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:01:28.001619 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received event network-vif-plugged-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:28.001796 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:28.001957 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:28.002171 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:28.002279 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] No waiting events found dispatching network-vif-plugged-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:28.002456 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-5b6cbfac-96f3-4d16-8ae3-edaacba5dc66 req-4d7b3253-05ac-4a35-aca6-a212daf13a72 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received unexpected event network-vif-plugged-da9da3ce-b0fd-4658-8440-3096b21ff91d for instance with vm_state building and task_state spawning. May 27 21:01:28.003022 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:01:28.004853 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:01:28.006389 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Instance spawned successfully. May 27 21:01:28.007714 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:01:28.011884 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:01:28.014991 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Instance spawned successfully. May 27 21:01:28.015417 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:01:28.019847 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:28.020257 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:28.020541 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:28.020734 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:28.146222 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:28.348470 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:28.362957 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:28.368837 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:28.396521 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:28.469697 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:28.470047 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:28.470047 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No VIF found with MAC fa:16:3e:94:fd:a2, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:28.470410 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Using config drive May 27 21:01:28.520379 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:28.520547 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:28.520923 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:28.521273 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:28.521568 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:28.521815 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:28.527820 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Took 7.02 seconds to spawn the instance on the hypervisor. May 27 21:01:28.527986 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:28.673130 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Updating instance_info_cache with network_info: [{"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:28.875606 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:01:28.875606 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:28.875606 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] VM Paused (Lifecycle Event) May 27 21:01:28.919909 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Successfully updated port: f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:28.972272 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4eb3f61d-3c78-421a-9bc1-91f3d0f3dc81 req-2b3fc9f3-ecef-459b-b3a0-6e405e7eb219 service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Received event network-changed-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:28.981602 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4eb3f61d-3c78-421a-9bc1-91f3d0f3dc81 req-2b3fc9f3-ecef-459b-b3a0-6e405e7eb219 service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Refreshing instance network info cache due to event network-changed-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:28.981602 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4eb3f61d-3c78-421a-9bc1-91f3d0f3dc81 req-2b3fc9f3-ecef-459b-b3a0-6e405e7eb219 service nova] Acquiring lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:28.981602 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4eb3f61d-3c78-421a-9bc1-91f3d0f3dc81 req-2b3fc9f3-ecef-459b-b3a0-6e405e7eb219 service nova] Acquired lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:28.981602 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4eb3f61d-3c78-421a-9bc1-91f3d0f3dc81 req-2b3fc9f3-ecef-459b-b3a0-6e405e7eb219 service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Refreshing network info cache for port f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:28.981821 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:29.035966 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Took 17.51 seconds to spawn the instance on the hypervisor. May 27 21:01:29.036086 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:29.044549 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Took 13.36 seconds to build instance. May 27 21:01:29.071857 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:29.071857 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:29.071988 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] No VIF found with MAC fa:16:3e:5e:af:46, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:29.072449 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Using config drive May 27 21:01:29.107555 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Creating config drive at /opt/stack/data/nova/instances/1597a38f-a6a7-45bd-86ec-3938926c5cc8/disk.config May 27 21:01:29.111122 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1597a38f-a6a7-45bd-86ec-3938926c5cc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp78ehqgt2 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:29.148042 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1597a38f-a6a7-45bd-86ec-3938926c5cc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp78ehqgt2" returned: 0 in 0.037s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:29.176673 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Releasing lock "refresh_cache-aac9c5e0-da16-44ef-b255-53b21d0cc63d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:29.177173 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Instance network_info: |[{"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:29.179507 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Start _get_guest_xml network_info=[{"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:29.181852 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:29.183629 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1213684862-1', uuid='aac9c5e0-da16-44ef-b255-53b21d0cc63d'), owner=OwnerMeta(userid='8ef4507fea674555a32ee8d5a982e7d6', username='tempest-TestMultiAttachVolumeSwap-28626955-project-member', projectid='3b0d658b24414d8aadb0cb04849300a3', projectname='tempest-TestMultiAttachVolumeSwap-28626955'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915689.183128) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:29.184833 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:29.185181 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:29.187962 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:29.187962 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:29.189117 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:29.193158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:29.204241 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1213684862-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-testmultiattachvolumeswap-server-1213684862-1',id=7,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfwKtizXaBz0MCTR1m5iV2opJ4gC7KfX1+235hm6r98nGePvaTPwaDqdHeiTLJ2PSdeYNmntcKtj5xT0l5WOyP88QlDWXCp5+kw9VixVKS7+BRbRQsaKBG5YMLdB3bveg==',key_name='tempest-keypair-1015459028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b0d658b24414d8aadb0cb04849300a3',ramdisk_id='',reservation_id='r-i83qhj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-28626955',owner_user_name='tempest-TestMultiAttachVolumeSwap-28626955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ef4507fea674555a32ee8d5a982e7d6',uuid=aac9c5e0-da16-44ef-b255-53b21d0cc63d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:29.204511 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converting VIF {"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:29.205085 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=d60a0341-d711-4a9b-83bb-cad3bf479f30,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a0341-d7') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:29.208277 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lazy-loading 'pci_devices' on Instance uuid aac9c5e0-da16-44ef-b255-53b21d0cc63d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:29.361198 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:29.361198 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:29.361198 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Creating image(s) May 27 21:01:29.361198 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "/opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:29.361595 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "/opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:29.362126 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "/opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:29.362668 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:29.365559 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:29.366696 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:29.382855 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:29.394282 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:29.394439 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] VM Resumed (Lifecycle Event) May 27 21:01:29.423711 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.432007 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:29.440613 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:01:29.441321 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:01:29.441654 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:01:29.442805 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:01:29.442805 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:01:29.442927 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:01:29.443261 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:01:29.445855 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98213) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} May 27 21:01:29.445855 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager.update_available_resource {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:01:29.457579 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.088s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:29.461685 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:29.461685 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:29.461685 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:29.474319 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:29.474782 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:29.486728 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-4eb3f61d-3c78-421a-9bc1-91f3d0f3dc81 req-2b3fc9f3-ecef-459b-b3a0-6e405e7eb219 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:29.551822 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Took 22.92 seconds to build instance. May 27 21:01:29.553863 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.887s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:29.563077 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.088s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:29.564199 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:29.580211 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4eb3f61d-3c78-421a-9bc1-91f3d0f3dc81 req-2b3fc9f3-ecef-459b-b3a0-6e405e7eb219 service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:29.595126 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:29.609445 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk 1073741824" returned: 0 in 0.045s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:29.609973 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.149s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:29.610432 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:29.633921 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.662330 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.666071 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.709775 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.099s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:29.710661 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:01:29.710661 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:29.713916 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] End _get_guest_xml xml= May 27 21:01:29.713916 np0000001553 nova-compute[98213]: aac9c5e0-da16-44ef-b255-53b21d0cc63d May 27 21:01:29.713916 np0000001553 nova-compute[98213]: instance-00000007 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 196608 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 1 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: tempest-TestMultiAttachVolumeSwap-server-1213684862-1 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 2026-05-27 21:01:29 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 192 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 1 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 0 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 0 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 1 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: True May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: bare May 27 21:01:29.713916 np0000001553 nova-compute[98213]: qcow2 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 1 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 0 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: virtio May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: tempest-TestMultiAttachVolumeSwap-28626955-project-member May 27 21:01:29.713916 np0000001553 nova-compute[98213]: tempest-TestMultiAttachVolumeSwap-28626955 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:29.713916 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: aac9c5e0-da16-44ef-b255-53b21d0cc63d May 27 21:01:29.713916 np0000001553 nova-compute[98213]: aac9c5e0-da16-44ef-b255-53b21d0cc63d May 27 21:01:29.713916 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: hvm May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 128 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: 1 May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: May 27 21:01:29.713916 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:29.717931 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Preparing to wait for external event network-vif-plugged-d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:29.717931 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:29.717931 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:29.717931 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:29.717931 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1213684862-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-testmultiattachvolumeswap-server-1213684862-1',id=7,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfwKtizXaBz0MCTR1m5iV2opJ4gC7KfX1+235hm6r98nGePvaTPwaDqdHeiTLJ2PSdeYNmntcKtj5xT0l5WOyP88QlDWXCp5+kw9VixVKS7+BRbRQsaKBG5YMLdB3bveg==',key_name='tempest-keypair-1015459028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b0d658b24414d8aadb0cb04849300a3',ramdisk_id='',reservation_id='r-i83qhj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-28626955',owner_user_name='tempest-TestMultiAttachVolumeSwap-28626955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ef4507fea674555a32ee8d5a982e7d6',uuid=aac9c5e0-da16-44ef-b255-53b21d0cc63d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:29.718228 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converting VIF {"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:29.726522 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=d60a0341-d711-4a9b-83bb-cad3bf479f30,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a0341-d7') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:29.727061 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=d60a0341-d711-4a9b-83bb-cad3bf479f30,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a0341-d7') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:29.737427 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.738164 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:29.739046 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:29.742012 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.742259 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb74f333-42d9-5097-8973-3fb09909e47f', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:29.746688 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.747696 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:29.759639 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.771703 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.771970 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd60a0341-d7, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:29.772650 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd60a0341-d7, col_values=(('qos', UUID('8d28c393-8467-4f3b-84c6-943a730cde80')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:29.772869 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd60a0341-d7, col_values=(('external_ids', {'iface-id': 'd60a0341-d711-4a9b-83bb-cad3bf479f30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:23:9e', 'vm-uuid': 'aac9c5e0-da16-44ef-b255-53b21d0cc63d'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:29.779940 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.784627 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:29.785503 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.786368 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:29.787289 np0000001553 nova-compute[98213]: INFO os_vif [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=d60a0341-d711-4a9b-83bb-cad3bf479f30,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a0341-d7') May 27 21:01:29.813464 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:29.813838 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Cannot resize image /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:01:29.814919 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:01:29.814919 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Ensure instance console log exists: /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:29.815101 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:29.815500 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:29.815707 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:29.845748 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4eb3f61d-3c78-421a-9bc1-91f3d0f3dc81 req-2b3fc9f3-ecef-459b-b3a0-6e405e7eb219 service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:29.861374 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Creating config drive at /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk.config May 27 21:01:29.865896 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdzj4q0fg {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:29.902699 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:29.905354 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdzj4q0fg" returned: 0 in 0.039s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:29.905865 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:29.953188 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:29.953507 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:29.953737 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:29.953936 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Auditing locally available compute resources for np0000001553 (node: np0000001553) {{(pid=98213) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} May 27 21:01:30.054036 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e025e67a-8b7d-462e-993d-98600ffb3f3a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "f4397c41-4087-4367-b1ac-46e8cc475772" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 24.430s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:30.066513 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.084365 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.102248 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.118748 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.178156 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-92e7ee6e-7fca-40e8-8d21-4a83dfa25109 req-eb06b92d-02f1-4e2a-9e98-04261e678fc3 service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Received event network-vif-unplugged-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:30.179031 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-92e7ee6e-7fca-40e8-8d21-4a83dfa25109 req-eb06b92d-02f1-4e2a-9e98-04261e678fc3 service nova] Acquiring lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:30.179608 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-92e7ee6e-7fca-40e8-8d21-4a83dfa25109 req-eb06b92d-02f1-4e2a-9e98-04261e678fc3 service nova] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:30.179608 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-92e7ee6e-7fca-40e8-8d21-4a83dfa25109 req-eb06b92d-02f1-4e2a-9e98-04261e678fc3 service nova] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:30.179608 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-92e7ee6e-7fca-40e8-8d21-4a83dfa25109 req-eb06b92d-02f1-4e2a-9e98-04261e678fc3 service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] No waiting events found dispatching network-vif-unplugged-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:30.179608 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-92e7ee6e-7fca-40e8-8d21-4a83dfa25109 req-eb06b92d-02f1-4e2a-9e98-04261e678fc3 service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Received unexpected event network-vif-unplugged-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 for instance with vm_state building and task_state spawning. May 27 21:01:30.348967 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4eb3f61d-3c78-421a-9bc1-91f3d0f3dc81 req-2b3fc9f3-ecef-459b-b3a0-6e405e7eb219 service nova] Releasing lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:30.349531 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquired lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:30.349948 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:30.408160 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.411058 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:30.411253 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] VM Resumed (Lifecycle Event) May 27 21:01:30.433363 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.436130 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.543322 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.790779 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.799892 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.806068 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.827121 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.837914 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:30.914321 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:30.918667 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:30.934109 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:31.150717 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:31.315889 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:31.319098 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:31.319298 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No VIF found with MAC fa:16:3e:f9:23:9e, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:31.319797 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Using config drive May 27 21:01:31.324946 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Updating instance_info_cache with network_info: [{"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:31.360010 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e1d26def-1953-4ffe-b412-6d3177a4d279 req-3c482c1b-ccac-4eaf-932e-1d99401f23c7 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received event network-changed-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:31.360226 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e1d26def-1953-4ffe-b412-6d3177a4d279 req-3c482c1b-ccac-4eaf-932e-1d99401f23c7 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Refreshing instance network info cache due to event network-changed-da9da3ce-b0fd-4658-8440-3096b21ff91d. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:31.360450 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e1d26def-1953-4ffe-b412-6d3177a4d279 req-3c482c1b-ccac-4eaf-932e-1d99401f23c7 service nova] Acquiring lock "refresh_cache-95d3c2a3-6ad3-4458-8771-4f95b37ad16c" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:31.363068 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e1d26def-1953-4ffe-b412-6d3177a4d279 req-3c482c1b-ccac-4eaf-932e-1d99401f23c7 service nova] Acquired lock "refresh_cache-95d3c2a3-6ad3-4458-8771-4f95b37ad16c" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:31.363394 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-e1d26def-1953-4ffe-b412-6d3177a4d279 req-3c482c1b-ccac-4eaf-932e-1d99401f23c7 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Refreshing network info cache for port da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:31.424436 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:31.424701 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] VM Started (Lifecycle Event) May 27 21:01:31.652940 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:31.660740 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:31.752273 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:31.752832 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:31.830348 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Releasing lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:31.836202 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Instance network_info: |[{"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:31.839540 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:31.842157 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:31.846165 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Start _get_guest_xml network_info=[{"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:31.850544 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:31.851338 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:31.852709 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1213684862-2', uuid='d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d'), owner=OwnerMeta(userid='8ef4507fea674555a32ee8d5a982e7d6', username='tempest-TestMultiAttachVolumeSwap-28626955-project-member', projectid='3b0d658b24414d8aadb0cb04849300a3', projectname='tempest-TestMultiAttachVolumeSwap-28626955'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915691.8523276) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:31.867822 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:31.868299 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:31.871114 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-e1d26def-1953-4ffe-b412-6d3177a4d279 req-3c482c1b-ccac-4eaf-932e-1d99401f23c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:31.876395 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:31.876614 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:31.878329 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:31.878606 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:31.878813 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:31.878955 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:31.879156 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:31.880835 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:31.885519 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:31.885815 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:31.885964 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:31.886157 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:31.886350 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:31.886527 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:31.913914 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1213684862-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-testmultiattachvolumeswap-server-1213684862-2',id=8,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfwKtizXaBz0MCTR1m5iV2opJ4gC7KfX1+235hm6r98nGePvaTPwaDqdHeiTLJ2PSdeYNmntcKtj5xT0l5WOyP88QlDWXCp5+kw9VixVKS7+BRbRQsaKBG5YMLdB3bveg==',key_name='tempest-keypair-1015459028',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b0d658b24414d8aadb0cb04849300a3',ramdisk_id='',reservation_id='r-i83qhj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-28626955',owner_user_name='tempest-TestMultiAttachVolumeSwap-28626955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ef4507fea674555a32ee8d5a982e7d6',uuid=d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:31.914076 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converting VIF {"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:31.914817 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:af:36,bridge_name='br-int',has_traffic_filtering=True,id=f22d5bf5-4ec9-44c2-956b-553ed90ce5c4,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22d5bf5-4e') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:31.916263 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lazy-loading 'pci_devices' on Instance uuid d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:31.928206 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:31.931304 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:31.931539 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] VM Paused (Lifecycle Event) May 27 21:01:31.937240 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:31.937240 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:32.019321 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:32.022445 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:32.049199 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Creating config drive at /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk.config May 27 21:01:32.056065 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmt453txg {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:32.095806 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmt453txg" returned: 0 in 0.039s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:32.105585 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:32.107263 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:32.127189 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8c5b0aa5-4b67-4d67-ab7a-8c5917c7bf3d req-6bb06fb0-5a78-4ce7-a2df-b8791ba4266c service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Received event network-vif-unplugged-44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:32.130366 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8c5b0aa5-4b67-4d67-ab7a-8c5917c7bf3d req-6bb06fb0-5a78-4ce7-a2df-b8791ba4266c service nova] Acquiring lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:32.130366 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8c5b0aa5-4b67-4d67-ab7a-8c5917c7bf3d req-6bb06fb0-5a78-4ce7-a2df-b8791ba4266c service nova] Lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:32.130366 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8c5b0aa5-4b67-4d67-ab7a-8c5917c7bf3d req-6bb06fb0-5a78-4ce7-a2df-b8791ba4266c service nova] Lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:32.130366 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8c5b0aa5-4b67-4d67-ab7a-8c5917c7bf3d req-6bb06fb0-5a78-4ce7-a2df-b8791ba4266c service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] No event matching network-vif-unplugged-44654d4f-25e2-4002-9a7f-af6cf7cac43c in dict_keys([('network-vif-plugged', '44654d4f-25e2-4002-9a7f-af6cf7cac43c')]) {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} May 27 21:01:32.130366 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-8c5b0aa5-4b67-4d67-ab7a-8c5917c7bf3d req-6bb06fb0-5a78-4ce7-a2df-b8791ba4266c service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Received unexpected event network-vif-unplugged-44654d4f-25e2-4002-9a7f-af6cf7cac43c for instance with vm_state building and task_state spawning. May 27 21:01:32.190591 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:32.195569 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:01:32.199342 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:32.268509 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received event network-vif-plugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:32.268785 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:32.269088 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:32.269320 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:32.269521 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Processing event network-vif-plugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:01:32.271011 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received event network-vif-plugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:32.271011 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:01:32.271325 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:32.271838 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:32.271900 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:32.272060 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] No waiting events found dispatching network-vif-plugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:32.272664 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-fa2d59d0-1ef2-466f-90c4-d20a6ea2f251 req-b2b14918-f395-484f-a540-1104e3983094 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received unexpected event network-vif-plugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 for instance with vm_state building and task_state spawning. May 27 21:01:32.277271 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:01:32.282956 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Instance spawned successfully. May 27 21:01:32.283287 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:01:32.291450 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:32.292084 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:32.395196 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:32.399158 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:32.419800 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-e1d26def-1953-4ffe-b412-6d3177a4d279 req-3c482c1b-ccac-4eaf-932e-1d99401f23c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:32.426793 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] End _get_guest_xml xml= May 27 21:01:32.426793 np0000001553 nova-compute[98213]: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d May 27 21:01:32.426793 np0000001553 nova-compute[98213]: instance-00000008 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 196608 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 1 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: tempest-TestMultiAttachVolumeSwap-server-1213684862-2 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 2026-05-27 21:01:31 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 192 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 1 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 0 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 0 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 1 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: True May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: bare May 27 21:01:32.426793 np0000001553 nova-compute[98213]: qcow2 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 1 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 0 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: virtio May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: tempest-TestMultiAttachVolumeSwap-28626955-project-member May 27 21:01:32.426793 np0000001553 nova-compute[98213]: tempest-TestMultiAttachVolumeSwap-28626955 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:32.426793 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d May 27 21:01:32.426793 np0000001553 nova-compute[98213]: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d May 27 21:01:32.426793 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: hvm May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 128 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: 1 May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: May 27 21:01:32.426793 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:32.429557 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Preparing to wait for external event network-vif-plugged-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:32.429823 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:32.430332 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:32.430564 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:32.431844 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1213684862-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-testmultiattachvolumeswap-server-1213684862-2',id=8,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfwKtizXaBz0MCTR1m5iV2opJ4gC7KfX1+235hm6r98nGePvaTPwaDqdHeiTLJ2PSdeYNmntcKtj5xT0l5WOyP88QlDWXCp5+kw9VixVKS7+BRbRQsaKBG5YMLdB3bveg==',key_name='tempest-keypair-1015459028',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b0d658b24414d8aadb0cb04849300a3',ramdisk_id='',reservation_id='r-i83qhj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-28626955',owner_user_name='tempest-TestMultiAttachVolumeSwap-28626955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ef4507fea674555a32ee8d5a982e7d6',uuid=d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:32.435752 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:32.435924 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converting VIF {"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:32.436617 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:af:36,bridge_name='br-int',has_traffic_filtering=True,id=f22d5bf5-4ec9-44c2-956b-553ed90ce5c4,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22d5bf5-4e') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:32.436975 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:af:36,bridge_name='br-int',has_traffic_filtering=True,id=f22d5bf5-4ec9-44c2-956b-553ed90ce5c4,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22d5bf5-4e') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:32.438507 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:32.439107 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:32.439547 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:32.444448 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:32.444448 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '069dea7d-85a6-5daf-b494-9fceaec8c44a', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:32.444856 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:32.447597 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:32.455781 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:32.463713 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:32.463713 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf22d5bf5-4e, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:32.463713 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf22d5bf5-4e, col_values=(('qos', UUID('f88b7521-8478-4a7e-831e-c4354eb5faaf')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:32.463713 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf22d5bf5-4e, col_values=(('external_ids', {'iface-id': 'f22d5bf5-4ec9-44c2-956b-553ed90ce5c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:af:36', 'vm-uuid': 'd42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:32.465505 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:32.468695 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:32.481108 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:32.488626 np0000001553 nova-compute[98213]: INFO os_vif [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:af:36,bridge_name='br-int',has_traffic_filtering=True,id=f22d5bf5-4ec9-44c2-956b-553ed90ce5c4,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22d5bf5-4e') May 27 21:01:32.489413 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:32.489858 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:32.511731 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:32.609222 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:32.619308 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:32.634393 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:32.638980 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:32.690731 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-e1d26def-1953-4ffe-b412-6d3177a4d279 req-3c482c1b-ccac-4eaf-932e-1d99401f23c7 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Updated VIF entry in instance network info cache for port da9da3ce-b0fd-4658-8440-3096b21ff91d. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:32.691128 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-e1d26def-1953-4ffe-b412-6d3177a4d279 req-3c482c1b-ccac-4eaf-932e-1d99401f23c7 service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Updating instance_info_cache with network_info: [{"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:32.761992 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:32.797438 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:32.797599 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:32.797930 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:32.798202 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:32.798747 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:32.799508 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:32.848234 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:32.933663 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:32.934007 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:32.952473 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:01:32.953977 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:32.953977 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] VM Started (Lifecycle Event) May 27 21:01:33.024641 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] instance snapshotting May 27 21:01:33.032525 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:33.040339 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:33.040558 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:33.066432 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:33.070987 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:33.076357 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "env LANG=C uptime" returned: 0 in 0.034s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:33.076357 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Hypervisor/Node resource view: name=np0000001553 free_ram=14118MB free_disk=74.76961517333984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98213) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} May 27 21:01:33.076738 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:33.076738 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:33.077352 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:33.100927 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:33.195767 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e1d26def-1953-4ffe-b412-6d3177a4d279 req-3c482c1b-ccac-4eaf-932e-1d99401f23c7 service nova] Releasing lock "refresh_cache-95d3c2a3-6ad3-4458-8771-4f95b37ad16c" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:33.198921 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Beginning live snapshot process May 27 21:01:33.308216 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Took 9.26 seconds to spawn the instance on the hypervisor. May 27 21:01:33.308342 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:33.459791 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:33.462129 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:33.820015 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Took 17.50 seconds to build instance. May 27 21:01:33.965753 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:33.965753 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] VM Paused (Lifecycle Event) May 27 21:01:33.987501 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:33.988907 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:34.025294 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:34.025294 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:34.025294 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No VIF found with MAC fa:16:3e:2b:af:36, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:34.025294 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Using config drive May 27 21:01:34.145084 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance f4397c41-4087-4367-b1ac-46e8cc475772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:01:34.145285 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 22e422c7-47a4-4619-92a8-b05b73989943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:01:34.145451 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance f0c8ea02-9725-47ed-b34b-13ea3552d09b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:01:34.145597 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 1597a38f-a6a7-45bd-86ec-3938926c5cc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:01:34.145738 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 95d3c2a3-6ad3-4458-8771-4f95b37ad16c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:01:34.145860 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 69083572-b3e6-403a-ae54-6f128a2c88f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:01:34.145992 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance aac9c5e0-da16-44ef-b255-53b21d0cc63d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:01:34.146119 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:01:34.214866 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Received event network-vif-unplugged-032fe0ad-2162-4bfc-9da0-bfa5f662aca9 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:34.215089 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Acquiring lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:34.215278 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:34.215883 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:34.216214 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] No event matching network-vif-unplugged-032fe0ad-2162-4bfc-9da0-bfa5f662aca9 in dict_keys([('network-vif-plugged', '032fe0ad-2162-4bfc-9da0-bfa5f662aca9')]) {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} May 27 21:01:34.216403 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Received unexpected event network-vif-unplugged-032fe0ad-2162-4bfc-9da0-bfa5f662aca9 for instance with vm_state building and task_state spawning. May 27 21:01:34.216634 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Received event network-vif-plugged-44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:34.216963 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Acquiring lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:34.217275 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:34.217381 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:34.217538 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Processing event network-vif-plugged-44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:01:34.217738 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Received event network-vif-plugged-44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:34.217869 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Acquiring lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:34.217981 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:34.218097 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:34.218267 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] No waiting events found dispatching network-vif-plugged-44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:34.218370 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Received unexpected event network-vif-plugged-44654d4f-25e2-4002-9a7f-af6cf7cac43c for instance with vm_state building and task_state spawning. May 27 21:01:34.219320 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Received event network-vif-unplugged-d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:34.219991 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Instance event wait completed in 11 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:01:34.220366 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Acquiring lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:34.220795 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:34.221351 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:34.221649 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] No event matching network-vif-unplugged-d60a0341-d711-4a9b-83bb-cad3bf479f30 in dict_keys([('network-vif-plugged', 'd60a0341-d711-4a9b-83bb-cad3bf479f30')]) {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} May 27 21:01:34.221966 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-426308b7-c242-4cbe-97cb-b350da5e05ab req-69f18122-0f8b-4101-b963-89920648c5c6 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Received unexpected event network-vif-unplugged-d60a0341-d711-4a9b-83bb-cad3bf479f30 for instance with vm_state building and task_state spawning. May 27 21:01:34.223165 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:01:34.225008 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Instance spawned successfully. May 27 21:01:34.225433 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:01:34.322076 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.006s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:34.468001 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:34.469348 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:34.469479 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] VM Resumed (Lifecycle Event) May 27 21:01:34.489963 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:34.533124 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:34.649228 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 950bfe97-53fd-4086-bfa5-69ea3a75c088 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} May 27 21:01:34.649228 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} May 27 21:01:34.649228 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Final resource view: name=np0000001553 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 21:01:33 up 27 min, 2 users, load average: 4.81, 2.27, 1.14\n', 'num_instances': '8', 'num_vm_active': '3', 'num_task_image_snapshot': '1', 'num_os_type_None': '8', 'num_proj_79fe4bede0c741bfb93a23985eeef42e': '1', 'io_workload': '6', 'num_task_None': '2', 'num_proj_92da496690954c8fb9c6eb722b956485': '1', 'num_vm_building': '5', 'num_task_spawning': '5', 'num_proj_b562b6a1ba2b4c3ab101af22f9d04713': '1', 'num_proj_251237411f6e4bb49303c88852d6e9a1': '1', 'num_proj_018d84b86f0542529549fee42f6b2815': '1', 'num_proj_071b2253516a48a496af623e0264802a': '1', 'num_proj_3b0d658b24414d8aadb0cb04849300a3': '2'} {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} May 27 21:01:34.699419 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Creating config drive at /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk.config May 27 21:01:34.704466 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxv3ckkix {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:34.735846 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:34.735960 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:34.736177 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:34.736449 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:34.736664 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:34.736924 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:34.740577 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json -f qcow2 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:34.758175 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxv3ckkix" returned: 0 in 0.051s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:34.838560 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json -f qcow2" returned: 0 in 0.098s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:34.839042 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json -f qcow2 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:34.907461 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json -f qcow2" returned: 0 in 0.068s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:34.907629 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:34.911158 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:34.911158 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:34.975164 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:34.982119 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:35.014898 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.102s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:35.014898 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp38ess0dq/4c827f0c34744a8d8943176f2fc79769.delta 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:35.096580 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:35.096869 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp38ess0dq/4c827f0c34744a8d8943176f2fc79769.delta 1073741824" returned: 0 in 0.080s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:35.097396 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Quiescing instance not available: QEMU guest agent is not enabled. May 27 21:01:35.265346 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Took 18.78 seconds to spawn the instance on the hypervisor. May 27 21:01:35.269396 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:35.312072 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:35.312908 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:35.438708 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98213) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} May 27 21:01:35.440780 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Skipping quiescing instance: QEMU guest agent is not enabled. May 27 21:01:35.485668 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:35.485779 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] VM Started (Lifecycle Event) May 27 21:01:35.547395 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:35.568013 np0000001553 nova-compute[98213]: DEBUG nova.privsep.utils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98213) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} May 27 21:01:35.568013 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp38ess0dq/4c827f0c34744a8d8943176f2fc79769.delta /opt/stack/data/nova/instances/snapshots/tmp38ess0dq/4c827f0c34744a8d8943176f2fc79769 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:35.583957 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:35.674897 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp38ess0dq/4c827f0c34744a8d8943176f2fc79769.delta /opt/stack/data/nova/instances/snapshots/tmp38ess0dq/4c827f0c34744a8d8943176f2fc79769" returned: 0 in 0.107s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:35.675793 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Snapshot extracted, beginning image upload May 27 21:01:35.682767 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:35.742543 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:35.788985 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Took 26.50 seconds to build instance. May 27 21:01:35.788985 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-839d3af5-015b-4fc2-8867-c95e290f9de6 req-2faf57e1-47e9-4eae-a527-8fc33a7b948c service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Received event network-vif-plugged-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:35.788985 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-839d3af5-015b-4fc2-8867-c95e290f9de6 req-2faf57e1-47e9-4eae-a527-8fc33a7b948c service nova] Acquiring lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:35.788985 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-839d3af5-015b-4fc2-8867-c95e290f9de6 req-2faf57e1-47e9-4eae-a527-8fc33a7b948c service nova] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:35.788985 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-839d3af5-015b-4fc2-8867-c95e290f9de6 req-2faf57e1-47e9-4eae-a527-8fc33a7b948c service nova] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:35.788985 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-839d3af5-015b-4fc2-8867-c95e290f9de6 req-2faf57e1-47e9-4eae-a527-8fc33a7b948c service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Processing event network-vif-plugged-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:01:35.816273 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:35.988981 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:35.993508 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:35.993508 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] VM Paused (Lifecycle Event) May 27 21:01:36.293002 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ef3247a0-c50e-4442-bfff-a3ac0861f31d req-f1b87370-914d-4002-ba60-2df63659765a service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received event network-changed-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:36.293131 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ef3247a0-c50e-4442-bfff-a3ac0861f31d req-f1b87370-914d-4002-ba60-2df63659765a service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Refreshing instance network info cache due to event network-changed-ac7f24ac-e29a-4ba6-b014-76d87fea9c22. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:36.293418 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ef3247a0-c50e-4442-bfff-a3ac0861f31d req-f1b87370-914d-4002-ba60-2df63659765a service nova] Acquiring lock "refresh_cache-69083572-b3e6-403a-ae54-6f128a2c88f9" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:36.294285 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ef3247a0-c50e-4442-bfff-a3ac0861f31d req-f1b87370-914d-4002-ba60-2df63659765a service nova] Acquired lock "refresh_cache-69083572-b3e6-403a-ae54-6f128a2c88f9" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:36.294483 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-ef3247a0-c50e-4442-bfff-a3ac0861f31d req-f1b87370-914d-4002-ba60-2df63659765a service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Refreshing network info cache for port ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:36.296115 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-05a97ec1-08be-43b6-b861-eb0240ed83d0 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "f0c8ea02-9725-47ed-b34b-13ea3552d09b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 28.017s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:36.321835 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Compute_service record updated for np0000001553:np0000001553 {{(pid=98213) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} May 27 21:01:36.322746 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.247s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:36.322746 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.233s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:36.323763 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 57.21 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:01:36.335137 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:36.335137 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Claim successful on node np0000001553 May 27 21:01:36.392177 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:01:36.398767 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:01:36.401331 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Instance spawned successfully. May 27 21:01:36.401786 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:01:36.495879 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:36.499048 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:36.657474 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:36.797394 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-ef3247a0-c50e-4442-bfff-a3ac0861f31d req-f1b87370-914d-4002-ba60-2df63659765a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:36.909363 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:36.909462 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:36.910574 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:36.910574 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:36.910574 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:36.911008 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:37.003433 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:01:37.003806 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:37.004014 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] VM Resumed (Lifecycle Event) May 27 21:01:37.192376 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-ef3247a0-c50e-4442-bfff-a3ac0861f31d req-f1b87370-914d-4002-ba60-2df63659765a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:37.362708 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-ef3247a0-c50e-4442-bfff-a3ac0861f31d req-f1b87370-914d-4002-ba60-2df63659765a service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Updated VIF entry in instance network info cache for port ac7f24ac-e29a-4ba6-b014-76d87fea9c22. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:37.362997 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-ef3247a0-c50e-4442-bfff-a3ac0861f31d req-f1b87370-914d-4002-ba60-2df63659765a service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Updating instance_info_cache with network_info: [{"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:37.390675 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-aa876399-7c11-4fd5-93c3-a746212f7e23 req-9b53d5ab-beec-413c-bcf2-18d6bb944fa7 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Received event network-changed-44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:37.391196 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-aa876399-7c11-4fd5-93c3-a746212f7e23 req-9b53d5ab-beec-413c-bcf2-18d6bb944fa7 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Refreshing instance network info cache due to event network-changed-44654d4f-25e2-4002-9a7f-af6cf7cac43c. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:37.391413 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aa876399-7c11-4fd5-93c3-a746212f7e23 req-9b53d5ab-beec-413c-bcf2-18d6bb944fa7 service nova] Acquiring lock "refresh_cache-f0c8ea02-9725-47ed-b34b-13ea3552d09b" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:37.391553 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aa876399-7c11-4fd5-93c3-a746212f7e23 req-9b53d5ab-beec-413c-bcf2-18d6bb944fa7 service nova] Acquired lock "refresh_cache-f0c8ea02-9725-47ed-b34b-13ea3552d09b" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:37.391720 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-aa876399-7c11-4fd5-93c3-a746212f7e23 req-9b53d5ab-beec-413c-bcf2-18d6bb944fa7 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Refreshing network info cache for port 44654d4f-25e2-4002-9a7f-af6cf7cac43c {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:37.419750 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Took 8.06 seconds to spawn the instance on the hypervisor. May 27 21:01:37.420536 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:37.465248 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:37.507751 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:37.511914 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:37.866589 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ef3247a0-c50e-4442-bfff-a3ac0861f31d req-f1b87370-914d-4002-ba60-2df63659765a service nova] Releasing lock "refresh_cache-69083572-b3e6-403a-ae54-6f128a2c88f9" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:37.875670 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b496ee2b-f44e-4ab5-bf0c-21ad817ce55e req-cf215017-a24d-440d-bffe-f614172d86de service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Received event network-vif-plugged-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:37.875811 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b496ee2b-f44e-4ab5-bf0c-21ad817ce55e req-cf215017-a24d-440d-bffe-f614172d86de service nova] Acquiring lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:37.875942 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b496ee2b-f44e-4ab5-bf0c-21ad817ce55e req-cf215017-a24d-440d-bffe-f614172d86de service nova] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:37.876160 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b496ee2b-f44e-4ab5-bf0c-21ad817ce55e req-cf215017-a24d-440d-bffe-f614172d86de service nova] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:37.876160 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b496ee2b-f44e-4ab5-bf0c-21ad817ce55e req-cf215017-a24d-440d-bffe-f614172d86de service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] No waiting events found dispatching network-vif-plugged-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:37.876341 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-b496ee2b-f44e-4ab5-bf0c-21ad817ce55e req-cf215017-a24d-440d-bffe-f614172d86de service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Received unexpected event network-vif-plugged-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 for instance with vm_state active and task_state None. May 27 21:01:37.898055 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-aa876399-7c11-4fd5-93c3-a746212f7e23 req-9b53d5ab-beec-413c-bcf2-18d6bb944fa7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:37.906967 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:37.909902 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:37.935105 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Took 17.30 seconds to build instance. May 27 21:01:38.014762 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:38.015396 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] VM Started (Lifecycle Event) May 27 21:01:38.347852 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-aa876399-7c11-4fd5-93c3-a746212f7e23 req-9b53d5ab-beec-413c-bcf2-18d6bb944fa7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:38.413361 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:38.439970 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.817s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:38.519756 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:38.525151 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:38.534479 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-aa876399-7c11-4fd5-93c3-a746212f7e23 req-9b53d5ab-beec-413c-bcf2-18d6bb944fa7 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Updated VIF entry in instance network info cache for port 44654d4f-25e2-4002-9a7f-af6cf7cac43c. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:38.534858 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-aa876399-7c11-4fd5-93c3-a746212f7e23 req-9b53d5ab-beec-413c-bcf2-18d6bb944fa7 service nova] [instance: f0c8ea02-9725-47ed-b34b-13ea3552d09b] Updating instance_info_cache with network_info: [{"id": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "address": "fa:16:3e:e5:70:25", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap44654d4f-25", "ovs_interfaceid": "44654d4f-25e2-4002-9a7f-af6cf7cac43c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:38.922236 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.598s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:38.922236 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:39.028550 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:39.029110 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] VM Paused (Lifecycle Event) May 27 21:01:39.037404 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aa876399-7c11-4fd5-93c3-a746212f7e23 req-9b53d5ab-beec-413c-bcf2-18d6bb944fa7 service nova] Releasing lock "refresh_cache-f0c8ea02-9725-47ed-b34b-13ea3552d09b" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:39.203963 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Snapshot image upload complete May 27 21:01:39.204383 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-aeb4c54a-c8be-4275-81a6-25657a5eeb64 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Took 6.18 seconds to snapshot the instance on the hypervisor. May 27 21:01:39.409481 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-89e8b988-102b-4b8d-b4ec-8c2f5ad6560a req-8b85ad17-de15-44cf-8b47-7f49743be661 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Received event network-vif-plugged-032fe0ad-2162-4bfc-9da0-bfa5f662aca9 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:39.410210 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-89e8b988-102b-4b8d-b4ec-8c2f5ad6560a req-8b85ad17-de15-44cf-8b47-7f49743be661 service nova] Acquiring lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:39.410210 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-89e8b988-102b-4b8d-b4ec-8c2f5ad6560a req-8b85ad17-de15-44cf-8b47-7f49743be661 service nova] Lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:39.410561 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-89e8b988-102b-4b8d-b4ec-8c2f5ad6560a req-8b85ad17-de15-44cf-8b47-7f49743be661 service nova] Lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:39.411013 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-89e8b988-102b-4b8d-b4ec-8c2f5ad6560a req-8b85ad17-de15-44cf-8b47-7f49743be661 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Processing event network-vif-plugged-032fe0ad-2162-4bfc-9da0-bfa5f662aca9 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:01:39.411506 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Instance event wait completed in 8 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:01:39.416594 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:01:39.419868 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Instance spawned successfully. May 27 21:01:39.420272 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:01:39.428782 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:39.429044 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:39.429429 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:39.429756 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:39.532971 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:39.534730 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:39.535060 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] VM Resumed (Lifecycle Event) May 27 21:01:39.582557 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '606bde5cb68847cc8b7b2af092fc6bd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811fd8e033640e18a7080fe0a65d975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:39.929326 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:01:39.934204 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:39.934204 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:39.934204 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:39.934204 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:39.937633 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:39.938045 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:40.039828 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:40.041462 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:40.255304 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Successfully created port: 8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:40.438702 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:40.446467 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Took 18.67 seconds to spawn the instance on the hypervisor. May 27 21:01:40.446615 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:40.549256 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:40.549409 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] VM Resumed (Lifecycle Event) May 27 21:01:40.597586 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:40.968493 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Took 29.73 seconds to build instance. May 27 21:01:41.021233 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Successfully updated port: 8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:41.056113 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:41.059389 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:41.467850 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:41.468942 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:41.469690 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4803b2dd-632e-45c7-aa3d-c18fdcee5cb1 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 31.235s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:41.469968 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Creating image(s) May 27 21:01:41.470512 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "/opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:41.470675 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "/opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:41.471327 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "/opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:41.471978 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:41.476077 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:41.477207 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:41.500308 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Received event network-vif-plugged-032fe0ad-2162-4bfc-9da0-bfa5f662aca9 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:41.500308 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Acquiring lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:41.501170 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:41.503015 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Lock "1597a38f-a6a7-45bd-86ec-3938926c5cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:41.503015 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] No waiting events found dispatching network-vif-plugged-032fe0ad-2162-4bfc-9da0-bfa5f662aca9 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:41.503349 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: 1597a38f-a6a7-45bd-86ec-3938926c5cc8] Received unexpected event network-vif-plugged-032fe0ad-2162-4bfc-9da0-bfa5f662aca9 for instance with vm_state active and task_state None. May 27 21:01:41.505265 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Received event network-vif-plugged-d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:41.505265 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Acquiring lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:41.505265 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:41.505265 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:41.505265 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Processing event network-vif-plugged-d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:01:41.505265 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Received event network-vif-plugged-d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:41.505265 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Acquiring lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:41.505265 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:41.505265 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:41.505265 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] No waiting events found dispatching network-vif-plugged-d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:41.506646 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Instance event wait completed in 7 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:01:41.507176 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Received unexpected event network-vif-plugged-d60a0341-d711-4a9b-83bb-cad3bf479f30 for instance with vm_state building and task_state spawning. May 27 21:01:41.507176 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-changed-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:41.507559 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Refreshing instance network info cache due to event network-changed-8c501903-cc36-46d4-9ca9-87394e07d00c. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:41.508651 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Acquiring lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:41.509195 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Acquired lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:41.509195 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Refreshing network info cache for port 8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:41.511661 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:01:41.515714 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Instance spawned successfully. May 27 21:01:41.519880 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:01:41.523070 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:41.565058 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:41.565214 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] VM Resumed (Lifecycle Event) May 27 21:01:41.575522 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.098s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:41.575935 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:41.576376 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:41.576828 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:41.580377 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:41.580551 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:41.657813 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:41.670356 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.089s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:41.673708 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:41.732766 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk 1073741824" returned: 0 in 0.059s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:41.734462 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.158s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:41.735883 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:41.819608 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:41.819794 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:41.864448 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.129s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:41.866324 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:01:41.866324 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:41.960843 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:41.961298 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Cannot resize image /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:01:41.961620 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:01:41.961792 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Ensure instance console log exists: /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:41.962054 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:41.962480 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:41.962480 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:42.014772 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:42.029368 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:42.029636 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:42.030062 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:42.031239 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:42.031239 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:42.031239 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:42.072165 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:42.075564 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:42.119255 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:42.326241 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:42.335219 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:42.466247 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:42.537084 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Took 15.81 seconds to spawn the instance on the hypervisor. May 27 21:01:42.537306 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:42.581523 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:01:42.839177 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-72c1da20-9867-4bc2-9f87-a68339acee64 req-2d60d50d-cfdf-4f11-8a89-1bc939fe2fb0 service nova] Releasing lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:42.839921 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquired lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:42.840360 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:42.885054 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:42.885368 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:42.888377 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:42.888607 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Claim successful on node np0000001553 May 27 21:01:43.048252 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Took 22.46 seconds to build instance. May 27 21:01:43.432585 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:43.548182 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b2fa6aa6-3966-40e7-9624-511e33fed93f tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.972s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:43.643911 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:43.821479 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating instance_info_cache with network_info: [{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:44.258237 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-11e53e7d-077e-4870-be97-551380bcb1a3 req-4f6f2aac-7192-431d-bbd4-7a648d5fbf1b service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Received event network-changed-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:44.261576 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-11e53e7d-077e-4870-be97-551380bcb1a3 req-4f6f2aac-7192-431d-bbd4-7a648d5fbf1b service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Refreshing instance network info cache due to event network-changed-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:44.261811 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-11e53e7d-077e-4870-be97-551380bcb1a3 req-4f6f2aac-7192-431d-bbd4-7a648d5fbf1b service nova] Acquiring lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:44.261955 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-11e53e7d-077e-4870-be97-551380bcb1a3 req-4f6f2aac-7192-431d-bbd4-7a648d5fbf1b service nova] Acquired lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:44.262270 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-11e53e7d-077e-4870-be97-551380bcb1a3 req-4f6f2aac-7192-431d-bbd4-7a648d5fbf1b service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Refreshing network info cache for port f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:44.326706 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Releasing lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:44.332755 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance network_info: |[{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:44.335743 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Start _get_guest_xml network_info=[{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:44.340776 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:44.343169 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-636487866', uuid='950bfe97-53fd-4086-bfa5-69ea3a75c088'), owner=OwnerMeta(userid='606bde5cb68847cc8b7b2af092fc6bd6', username='tempest-ServerActionsTestOtherB-1747713240-project-member', projectid='3811fd8e033640e18a7080fe0a65d975', projectname='tempest-ServerActionsTestOtherB-1747713240'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915704.341912) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:44.346829 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:44.347331 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:44.351840 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:44.352096 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:44.353090 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:44.353709 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:44.354149 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:44.354149 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:44.354149 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:44.355258 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:44.355258 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:44.355258 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:44.355258 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:44.355258 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:44.355258 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:44.355258 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:44.370111 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-636487866',display_name='tempest-ServerActionsTestOtherB-server-636487866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serveractionstestotherb-server-636487866',id=9,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP37vEU7tk6IZLG6nGgYJrRWC1XysqG9qhj9f6Ts3gEcgfRgE2Kuebb5geAJYt0lQJDqjDBxoFON2pCBOOFgVRPjkb/YhHT2yjUMuBmc0jN1WzS2xreRxA0w+OzMqxnUwQ==',key_name='tempest-keypair-736936884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3811fd8e033640e18a7080fe0a65d975',ramdisk_id='',reservation_id='r-004tqvtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1747713240',owner_user_name='tempest-ServerActionsTestOtherB-1747713240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='606bde5cb68847cc8b7b2af092fc6bd6',uuid=950bfe97-53fd-4086-bfa5-69ea3a75c088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:44.370773 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converting VIF {"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:44.371577 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:44.372395 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lazy-loading 'pci_devices' on Instance uuid 950bfe97-53fd-4086-bfa5-69ea3a75c088 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:44.600322 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:44.600322 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:44.765135 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-11e53e7d-077e-4870-be97-551380bcb1a3 req-4f6f2aac-7192-431d-bbd4-7a648d5fbf1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:44.877070 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] End _get_guest_xml xml= May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 950bfe97-53fd-4086-bfa5-69ea3a75c088 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: instance-00000009 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 196608 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 1 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherB-server-636487866 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 2026-05-27 21:01:44 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 192 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 1 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 0 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 0 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 1 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: True May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: bare May 27 21:01:44.877070 np0000001553 nova-compute[98213]: qcow2 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 1 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 0 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: virtio May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherB-1747713240-project-member May 27 21:01:44.877070 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherB-1747713240 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:44.877070 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 950bfe97-53fd-4086-bfa5-69ea3a75c088 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 950bfe97-53fd-4086-bfa5-69ea3a75c088 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: hvm May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 128 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: 1 May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: May 27 21:01:44.877070 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:44.879432 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Preparing to wait for external event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:44.879432 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:44.879432 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:44.879432 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:44.879432 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-636487866',display_name='tempest-ServerActionsTestOtherB-server-636487866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serveractionstestotherb-server-636487866',id=9,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP37vEU7tk6IZLG6nGgYJrRWC1XysqG9qhj9f6Ts3gEcgfRgE2Kuebb5geAJYt0lQJDqjDBxoFON2pCBOOFgVRPjkb/YhHT2yjUMuBmc0jN1WzS2xreRxA0w+OzMqxnUwQ==',key_name='tempest-keypair-736936884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3811fd8e033640e18a7080fe0a65d975',ramdisk_id='',reservation_id='r-004tqvtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1747713240',owner_user_name='tempest-ServerActionsTestOtherB-1747713240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='606bde5cb68847cc8b7b2af092fc6bd6',uuid=950bfe97-53fd-4086-bfa5-69ea3a75c088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:44.879701 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converting VIF {"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:44.879701 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:44.879701 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:44.880089 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:44.880517 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:44.880880 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:44.884242 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:44.886250 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba92b8c4-16bc-5bb1-91f6-86d37a709949', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:44.896000 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:44.897187 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:44.897187 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:44.901745 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:44.901963 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c501903-cc, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:44.902459 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c501903-cc, col_values=(('qos', UUID('eb3fc696-1e61-43f8-a153-57918b4a303d')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:44.902656 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c501903-cc, col_values=(('external_ids', {'iface-id': '8c501903-cc36-46d4-9ca9-87394e07d00c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:3a:d3', 'vm-uuid': '950bfe97-53fd-4086-bfa5-69ea3a75c088'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:44.904810 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:44.906414 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:44.911582 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:44.913123 np0000001553 nova-compute[98213]: INFO os_vif [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') May 27 21:01:44.981447 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "a6108bdf-d518-447f-927d-43d7fa6456e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:44.981447 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:45.104978 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:45.161668 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-11e53e7d-077e-4870-be97-551380bcb1a3 req-4f6f2aac-7192-431d-bbd4-7a648d5fbf1b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:45.314606 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-11e53e7d-077e-4870-be97-551380bcb1a3 req-4f6f2aac-7192-431d-bbd4-7a648d5fbf1b service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Updated VIF entry in instance network info cache for port f22d5bf5-4ec9-44c2-956b-553ed90ce5c4. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:45.314899 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-11e53e7d-077e-4870-be97-551380bcb1a3 req-4f6f2aac-7192-431d-bbd4-7a648d5fbf1b service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Updating instance_info_cache with network_info: [{"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:45.485722 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:01:45.614748 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.729s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:45.615291 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:45.817883 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-11e53e7d-077e-4870-be97-551380bcb1a3 req-4f6f2aac-7192-431d-bbd4-7a648d5fbf1b service nova] Releasing lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:46.048429 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:46.048618 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:46.051367 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:01:46.051529 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Claim successful on node np0000001553 May 27 21:01:46.120775 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:46.121562 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:46.121562 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:46.121707 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:46.196909 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18e30c231082464ab556592986d8b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fe4bede0c741bfb93a23985eeef42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:46.436182 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:46.436182 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:46.436182 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No VIF found with MAC fa:16:3e:83:3a:d3, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:46.436554 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Using config drive May 27 21:01:46.625020 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:01:46.659595 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:46.765555 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Successfully created port: f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:46.944308 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:47.131285 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:47.149746 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Creating config drive at /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.config May 27 21:01:47.158494 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzslpj3qk {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:47.209835 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzslpj3qk" returned: 0 in 0.051s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:47.464490 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Successfully updated port: f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:47.530308 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-59f0a12b-ede1-4870-9f08-5bfe225977e1 req-18da5cf8-6244-4852-ab1b-6f2f9b8122af service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-changed-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:47.530416 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-59f0a12b-ede1-4870-9f08-5bfe225977e1 req-18da5cf8-6244-4852-ab1b-6f2f9b8122af service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Refreshing instance network info cache due to event network-changed-f95bc266-b629-40ae-8a9b-8b0df38a03f8. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:47.530604 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-59f0a12b-ede1-4870-9f08-5bfe225977e1 req-18da5cf8-6244-4852-ab1b-6f2f9b8122af service nova] Acquiring lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:47.530698 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-59f0a12b-ede1-4870-9f08-5bfe225977e1 req-18da5cf8-6244-4852-ab1b-6f2f9b8122af service nova] Acquired lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:47.530849 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-59f0a12b-ede1-4870-9f08-5bfe225977e1 req-18da5cf8-6244-4852-ab1b-6f2f9b8122af service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Refreshing network info cache for port f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:47.783676 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Booting with blank volume at /dev/vda May 27 21:01:47.793777 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:47.917432 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:47.967586 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:48.027341 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b8d8ce39-ca88-43d9-ba35-e2d9a4f68883 req-1f8850c3-1f93-42f6-ae99-f431f4d95347 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:48.027871 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b8d8ce39-ca88-43d9-ba35-e2d9a4f68883 req-1f8850c3-1f93-42f6-ae99-f431f4d95347 service nova] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:48.028072 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b8d8ce39-ca88-43d9-ba35-e2d9a4f68883 req-1f8850c3-1f93-42f6-ae99-f431f4d95347 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:48.028311 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b8d8ce39-ca88-43d9-ba35-e2d9a4f68883 req-1f8850c3-1f93-42f6-ae99-f431f4d95347 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:48.028478 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b8d8ce39-ca88-43d9-ba35-e2d9a4f68883 req-1f8850c3-1f93-42f6-ae99-f431f4d95347 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Processing event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:01:48.034169 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-59f0a12b-ede1-4870-9f08-5bfe225977e1 req-18da5cf8-6244-4852-ab1b-6f2f9b8122af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:48.113971 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:01:48.114230 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:01:48.194680 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-59f0a12b-ede1-4870-9f08-5bfe225977e1 req-18da5cf8-6244-4852-ab1b-6f2f9b8122af service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:48.211215 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:48.215947 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:48.225080 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:48.244169 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:48.494292 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-59f0a12b-ede1-4870-9f08-5bfe225977e1 req-18da5cf8-6244-4852-ab1b-6f2f9b8122af service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:48.618302 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:01:48.841871 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:01:48.844445 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:48.844445 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Started (Lifecycle Event) May 27 21:01:48.846337 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:01:48.849529 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance spawned successfully. May 27 21:01:48.853088 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:01:48.997794 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-59f0a12b-ede1-4870-9f08-5bfe225977e1 req-18da5cf8-6244-4852-ab1b-6f2f9b8122af service nova] Releasing lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:48.998331 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquired lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:48.998563 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:49.126812 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.078s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:49.127155 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:01:49.346019 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:49.348269 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:49.365167 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:49.365167 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:49.365167 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:49.365167 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:49.365167 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:49.365167 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:49.581570 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:49.634660 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:01:49.634660 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:01:49.634788 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:49.634917 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:49.764240 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac9557e825354813ac31afa70f07ffc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251237411f6e4bb49303c88852d6e9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:01:49.846023 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:49.851487 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:01:49.856631 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:49.856631 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Paused (Lifecycle Event) May 27 21:01:49.872363 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Took 8.40 seconds to spawn the instance on the hypervisor. May 27 21:01:49.872363 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:49.905625 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:50.062243 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Updating instance_info_cache with network_info: [{"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:50.103194 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c84e7e8a-0869-4361-b953-932a59b1daf5 req-5f6a5e51-9023-48f2-82b2-5b8b57083730 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:50.104542 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c84e7e8a-0869-4361-b953-932a59b1daf5 req-5f6a5e51-9023-48f2-82b2-5b8b57083730 service nova] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:50.104726 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c84e7e8a-0869-4361-b953-932a59b1daf5 req-5f6a5e51-9023-48f2-82b2-5b8b57083730 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:50.104874 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c84e7e8a-0869-4361-b953-932a59b1daf5 req-5f6a5e51-9023-48f2-82b2-5b8b57083730 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:50.105082 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c84e7e8a-0869-4361-b953-932a59b1daf5 req-5f6a5e51-9023-48f2-82b2-5b8b57083730 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] No waiting events found dispatching network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:50.105082 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-c84e7e8a-0869-4361-b953-932a59b1daf5 req-5f6a5e51-9023-48f2-82b2-5b8b57083730 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received unexpected event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c for instance with vm_state active and task_state None. May 27 21:01:50.144153 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:01:50.347316 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Successfully created port: 7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:01:50.359504 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:50.361003 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:50.361170 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Resumed (Lifecycle Event) May 27 21:01:50.385178 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Took 15.39 seconds to build instance. May 27 21:01:50.564400 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Releasing lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:50.564759 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Instance network_info: |[{"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:50.650295 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:01:50.865963 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:50.867277 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:50.887819 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-107ceda8-3a19-48cb-9ad5-5fc4f3bc0782 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.900s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:50.920100 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Successfully updated port: 7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:01:51.424664 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:51.424664 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquired lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:51.424664 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:01:51.556326 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:01:51.569668 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:01:51.593330 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:51.620698 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:01:51.621056 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:01:51.630875 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:01:51.632702 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::b04a:b6ff:fe52:4741', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe82:28ab', 'fe80::8c48:f9ff:fef4:76f6', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe5e:af46', 'fe80::60c7:cff:fed6:aac2', 'fe80::fc16:3eff:fef9:239e', 'fe80::f4a8:7bff:feae:7ec3', 'fe80::fc16:3eff:fe2b:af36', 'fe80::fc16:3eff:fe83:3ad3', 'fe80::f44b:ecff:feb6:e23'] May 27 21:01:51.632864 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:01:51.633012 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:01:51.634175 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] <== get_connector_properties: return (76ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:01:51.634527 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Updating existing volume attachment record: a2251e70-cd15-4386-a105-74899f2e7325 {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:01:51.662573 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:51.663631 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:51.664797 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Creating image(s) May 27 21:01:51.666805 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:51.666805 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "/opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:51.666805 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "/opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:51.667023 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:51.671191 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:51.671700 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:51.676027 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:51.767200 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.091s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:51.767707 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:51.768242 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:51.768767 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:51.772628 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:01:51.772935 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:51.857463 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.084s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:51.857868 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:51.891675 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk 1073741824" returned: 0 in 0.033s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:51.892373 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.124s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:51.892373 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:51.972966 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.080s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:51.974228 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:01:51.974463 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:52.052277 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:01:52.078724 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:52.079648 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Cannot resize image /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:01:52.080132 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:01:52.080402 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Ensure instance console log exists: /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:52.080757 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:52.081043 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:52.083002 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:52.194357 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ce0cebcd-e8aa-4141-99aa-6c74cf216be4 req-4b7ee35f-46d9-4e03-9a90-559c7ef0908e service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Received event network-changed-7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:52.194357 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ce0cebcd-e8aa-4141-99aa-6c74cf216be4 req-4b7ee35f-46d9-4e03-9a90-559c7ef0908e service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Refreshing instance network info cache due to event network-changed-7cafc030-613a-41b2-9c2a-17b2375b1960. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:52.194357 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ce0cebcd-e8aa-4141-99aa-6c74cf216be4 req-4b7ee35f-46d9-4e03-9a90-559c7ef0908e service nova] Acquiring lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:52.309652 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:52.443688 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Updating instance_info_cache with network_info: [{"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:52.950943 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Releasing lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:52.951373 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Instance network_info: |[{"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:01:52.951677 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ce0cebcd-e8aa-4141-99aa-6c74cf216be4 req-4b7ee35f-46d9-4e03-9a90-559c7ef0908e service nova] Acquired lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:52.951842 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-ce0cebcd-e8aa-4141-99aa-6c74cf216be4 req-4b7ee35f-46d9-4e03-9a90-559c7ef0908e service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Refreshing network info cache for port 7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:52.954086 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Start _get_guest_xml network_info=[{"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:52.957545 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:52.958792 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='a6108bdf-d518-447f-927d-43d7fa6456e2'), owner=OwnerMeta(userid='ac9557e825354813ac31afa70f07ffc7', username='tempest-AttachVolumeMultiAttachTest-1088868426-project-member', projectid='251237411f6e4bb49303c88852d6e9a1', projectname='tempest-AttachVolumeMultiAttachTest-1088868426'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915712.958456) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:52.959718 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:52.960112 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:52.960778 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:52.960926 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:52.961990 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:52.962155 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:52.962311 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:52.962405 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:52.962582 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:52.962640 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:52.962718 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:52.962864 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:52.962974 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:52.963096 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:52.963238 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:52.963363 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:52.974374 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='multiattach-server-0',id=11,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-fbp1jy4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=a6108bdf-d518-447f-927d-43d7fa6456e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:52.974643 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:52.975111 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=7cafc030-613a-41b2-9c2a-17b2375b1960,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cafc030-61') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:52.975672 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'pci_devices' on Instance uuid a6108bdf-d518-447f-927d-43d7fa6456e2 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:53.456072 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-ce0cebcd-e8aa-4141-99aa-6c74cf216be4 req-4b7ee35f-46d9-4e03-9a90-559c7ef0908e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:53.479166 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] End _get_guest_xml xml= May 27 21:01:53.479166 np0000001553 nova-compute[98213]: a6108bdf-d518-447f-927d-43d7fa6456e2 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: instance-0000000b May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 196608 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 1 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: multiattach-server-0 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 2026-05-27 21:01:52 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 192 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 1 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 0 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 0 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 1 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: True May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: bare May 27 21:01:53.479166 np0000001553 nova-compute[98213]: qcow2 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 1 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 0 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: virtio May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426-project-member May 27 21:01:53.479166 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:53.479166 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: a6108bdf-d518-447f-927d-43d7fa6456e2 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: a6108bdf-d518-447f-927d-43d7fa6456e2 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: hvm May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 128 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: 1 May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: May 27 21:01:53.479166 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:53.485380 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Preparing to wait for external event network-vif-plugged-7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:53.485380 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "a6108bdf-d518-447f-927d-43d7fa6456e2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:53.485380 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:53.485380 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:53.485380 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='multiattach-server-0',id=11,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-fbp1jy4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=a6108bdf-d518-447f-927d-43d7fa6456e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:53.485593 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:53.485593 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=7cafc030-613a-41b2-9c2a-17b2375b1960,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cafc030-61') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:53.485593 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=7cafc030-613a-41b2-9c2a-17b2375b1960,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cafc030-61') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:53.485593 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:53.485593 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:53.485593 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:53.485593 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:53.485593 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4114ea7d-bfa5-5d24-b563-072097165a15', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:53.486315 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:53.487346 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:53.487742 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:53.490968 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:53.491540 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cafc030-61, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:53.493613 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cafc030-61, col_values=(('qos', UUID('028efbe5-1472-4d64-b5ba-22f8e39efcc4')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:53.493613 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cafc030-61, col_values=(('external_ids', {'iface-id': '7cafc030-613a-41b2-9c2a-17b2375b1960', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:51:b6', 'vm-uuid': 'a6108bdf-d518-447f-927d-43d7fa6456e2'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:53.493613 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:53.495215 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:53.502129 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:53.502341 np0000001553 nova-compute[98213]: INFO os_vif [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:51:b6,bridge_name='br-int',has_traffic_filtering=True,id=7cafc030-613a-41b2-9c2a-17b2375b1960,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cafc030-61') May 27 21:01:53.797102 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:01:53.798554 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:01:53.798811 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Creating image(s) May 27 21:01:53.799164 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Did not create local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} May 27 21:01:53.799324 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Ensure instance console log exists: /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:01:53.801234 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:53.801234 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:53.801234 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:53.801234 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Start _get_guest_xml network_info=[{"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ee18ee77-6bda-4fb4-ba2b-7a8773411ad4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'serial': 'e465466e-bf1f-44ad-ba71-972248b28143'}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'a2251e70-cd15-4386-a105-74899f2e7325', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:01:53.803756 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:01:53.804944 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1283714548', uuid='ee18ee77-6bda-4fb4-ba2b-7a8773411ad4'), owner=OwnerMeta(userid='18e30c231082464ab556592986d8b793', username='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member', projectid='79fe4bede0c741bfb93a23985eeef42e', projectname='tempest-ServerBootFromVolumeStableRescueTest-1106755838'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915713.8046136) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:01:53.805841 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:01:53.806315 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:01:53.807033 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:01:53.807269 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:01:53.808225 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:01:53.811183 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:01:53.825235 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-ce0cebcd-e8aa-4141-99aa-6c74cf216be4 req-4b7ee35f-46d9-4e03-9a90-559c7ef0908e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:53.832106 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:01:53.832106 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:01:53.832106 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:01:53.832467 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:01:53.832467 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:01:53.848301 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:01:53.848301 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:01:53.848301 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:01:53.848534 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:01:53.849048 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:01:53.849328 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:01:53.859927 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:01:53.859927 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:53.868470 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:01:53.868470 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:53.877231 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143] added May 27 21:01:53.877231 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:01:53.877231 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:01:53.877231 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:01:53.877231 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:01:53.877231 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:01:53.877231 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:53.877791 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:01:53.878136 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:01:53.878451 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:01:53.888489 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143] added May 27 21:01:53.888489 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:01:53.888489 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:01:53.888489 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:01:53.888489 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:01:53.888489 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:01:53.888489 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:53.888751 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:01:53.888852 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0395(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:01:53.889129 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:01:54.038165 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-ce0cebcd-e8aa-4141-99aa-6c74cf216be4 req-4b7ee35f-46d9-4e03-9a90-559c7ef0908e service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Updated VIF entry in instance network info cache for port 7cafc030-613a-41b2-9c2a-17b2375b1960. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:54.038165 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-ce0cebcd-e8aa-4141-99aa-6c74cf216be4 req-4b7ee35f-46d9-4e03-9a90-559c7ef0908e service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Updating instance_info_cache with network_info: [{"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:54.258819 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93ca7e16-0830-499b-a45c-67f31a981dbb req-4da351f5-8424-4c0e-b52f-db09630ff5d3 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-changed-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:54.259764 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93ca7e16-0830-499b-a45c-67f31a981dbb req-4da351f5-8424-4c0e-b52f-db09630ff5d3 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Refreshing instance network info cache due to event network-changed-8c501903-cc36-46d4-9ca9-87394e07d00c. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:01:54.260029 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93ca7e16-0830-499b-a45c-67f31a981dbb req-4da351f5-8424-4c0e-b52f-db09630ff5d3 service nova] Acquiring lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:01:54.260171 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93ca7e16-0830-499b-a45c-67f31a981dbb req-4da351f5-8424-4c0e-b52f-db09630ff5d3 service nova] Acquired lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:01:54.260315 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-93ca7e16-0830-499b-a45c-67f31a981dbb req-4da351f5-8424-4c0e-b52f-db09630ff5d3 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Refreshing network info cache for port 8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:01:54.538966 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ce0cebcd-e8aa-4141-99aa-6c74cf216be4 req-4b7ee35f-46d9-4e03-9a90-559c7ef0908e service nova] Releasing lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:54.762395 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-93ca7e16-0830-499b-a45c-67f31a981dbb req-4da351f5-8424-4c0e-b52f-db09630ff5d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:54.878842 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.state = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:01:54.889489 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:01:54.889489 np0000001553 nova-compute[98213]: # END RECORD May 27 21:01:54.889489 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:54.891257 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.state = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:01:54.903801 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:01:54.903801 np0000001553 nova-compute[98213]: # END RECORD May 27 21:01:54.903801 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:54.910005 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:54.916003 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:54.925899 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.925899 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.925899 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:01:54.925899 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.925899 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.925899 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:01:54.937509 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.937509 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.937509 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:01:54.937881 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.937881 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.937881 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:01:54.962303 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143, portal: 192.168.40.100,3260] May 27 21:01:54.962303 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143, portal: 192.168.40.100,3260] successful. May 27 21:01:54.962303 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:54.976428 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:54.984581 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143, portal: 192.168.50.100,3260] May 27 21:01:54.984581 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143, portal: 192.168.50.100,3260] successful. May 27 21:01:54.984581 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:54.990294 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.990294 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.990294 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:01:54.990294 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:01:54.990294 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:01:54.990294 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.990294 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:54.990294 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:01:54.990294 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:01:54.990294 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:01:54.990554 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:01:54.990624 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:01:54.992669 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] HCTL ('9', '-', '-', 0) found on session 5 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:01:54.992669 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:01:54.997817 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:01:55.012723 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching for a device in session 5 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:01:55.012723 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:01:55.013768 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:55.013768 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:55.013768 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:01:55.013768 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:01:55.013768 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:01:55.015324 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:55.015324 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:01:55.015324 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:01:55.015324 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:01:55.015324 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:01:55.015324 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:01:55.015324 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:01:55.015568 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] HCTL ('10', '-', '-', 0) found on session 6 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:01:55.015568 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:01:55.023474 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:55.023648 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:55.023648 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No VIF found with MAC fa:16:3e:12:51:b6, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:55.025605 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Using config drive May 27 21:01:55.036881 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:01:55.037030 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:01:55.210220 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-93ca7e16-0830-499b-a45c-67f31a981dbb req-4da351f5-8424-4c0e-b52f-db09630ff5d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:55.395009 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-93ca7e16-0830-499b-a45c-67f31a981dbb req-4da351f5-8424-4c0e-b52f-db09630ff5d3 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updated VIF entry in instance network info cache for port 8c501903-cc36-46d4-9ca9-87394e07d00c. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:01:55.395450 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-93ca7e16-0830-499b-a45c-67f31a981dbb req-4da351f5-8424-4c0e-b52f-db09630ff5d3 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating instance_info_cache with network_info: [{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:01:55.531173 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:01:55.661274 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Creating config drive at /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk.config May 27 21:01:55.666081 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt831in_p {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:01:55.702809 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt831in_p" returned: 0 in 0.036s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:01:55.854752 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:01:55.898487 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93ca7e16-0830-499b-a45c-67f31a981dbb req-4da351f5-8424-4c0e-b52f-db09630ff5d3 service nova] Releasing lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:01:56.153617 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:56.190047 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:56.277553 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:56.324847 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:56.324847 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:56.341593 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-70316feb-a1fd-4c6a-9295-dd973a474a48 req-a803d14a-86ba-4c85-89da-bc9f54901d9c service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Received event network-vif-plugged-7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:56.343024 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-70316feb-a1fd-4c6a-9295-dd973a474a48 req-a803d14a-86ba-4c85-89da-bc9f54901d9c service nova] Acquiring lock "a6108bdf-d518-447f-927d-43d7fa6456e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:56.343119 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-70316feb-a1fd-4c6a-9295-dd973a474a48 req-a803d14a-86ba-4c85-89da-bc9f54901d9c service nova] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:56.343304 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-70316feb-a1fd-4c6a-9295-dd973a474a48 req-a803d14a-86ba-4c85-89da-bc9f54901d9c service nova] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:56.343364 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-70316feb-a1fd-4c6a-9295-dd973a474a48 req-a803d14a-86ba-4c85-89da-bc9f54901d9c service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Processing event network-vif-plugged-7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:01:56.664918 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:56.870348 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Found WWN 33000000021da23ae for multipath device dm-3 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:01:56.870722 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:01:56.871005 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '33000000021da23ae', 'path': '/dev/dm-3', 'multipath_id': '33000000021da23ae'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:01:56.871260 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000021da23ae', 'path': '/dev/dm-3', 'multipath_id': '33000000021da23ae'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:01:56.906538 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:56.907790 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:01:56.908091 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] VM Started (Lifecycle Event) May 27 21:01:56.910269 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:01:56.911510 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Instance spawned successfully. May 27 21:01:56.911800 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:01:57.381249 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1283714548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-1283714548',id=10,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-xdon22jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:47Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=ee18ee77-6bda-4fb4-ba2b-7a8773411ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:01:57.381249 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:57.381249 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=f95bc266-b629-40ae-8a9b-8b0df38a03f8,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95bc266-b6') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:57.381249 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'pci_devices' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:01:57.410842 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:57.412246 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:57.423172 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:57.423172 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:57.423172 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:57.423172 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:57.423172 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:57.424889 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:01:57.884587 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] End _get_guest_xml xml= May 27 21:01:57.884587 np0000001553 nova-compute[98213]: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: instance-0000000a May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 196608 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 1 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-server-1283714548 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 2026-05-27 21:01:53 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 192 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 1 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 0 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 0 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 1 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: True May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: bare May 27 21:01:57.884587 np0000001553 nova-compute[98213]: qcow2 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 1 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 0 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: virtio May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member May 27 21:01:57.884587 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:01:57.884587 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: hvm May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 128 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: 1 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: Nehalem May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: e465466e-bf1f-44ad-ba71-972248b28143 May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: May 27 21:01:57.884587 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:01:57.888156 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Preparing to wait for external event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:01:57.888156 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:57.888156 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:57.888156 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:57.888156 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1283714548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-1283714548',id=10,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-xdon22jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:01:47Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=ee18ee77-6bda-4fb4-ba2b-7a8773411ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:01:57.888410 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:01:57.888608 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=f95bc266-b629-40ae-8a9b-8b0df38a03f8,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95bc266-b6') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:01:57.888915 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=f95bc266-b629-40ae-8a9b-8b0df38a03f8,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95bc266-b6') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:01:57.889268 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:57.889496 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:57.889738 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:01:57.891393 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:57.891810 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bc97da1-de96-5bc9-b685-72d2bb24fb93', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:57.892751 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:57.895177 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:57.896405 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:57.898517 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:57.899670 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf95bc266-b6, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:57.899670 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf95bc266-b6, col_values=(('qos', UUID('e7cecede-322f-4565-867d-ee18af4cd689')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:57.899670 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf95bc266-b6, col_values=(('external_ids', {'iface-id': 'f95bc266-b629-40ae-8a9b-8b0df38a03f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:c7:fc', 'vm-uuid': 'ee18ee77-6bda-4fb4-ba2b-7a8773411ad4'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:01:57.900729 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:57.901786 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:01:57.906110 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:01:57.907326 np0000001553 nova-compute[98213]: INFO os_vif [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=f95bc266-b629-40ae-8a9b-8b0df38a03f8,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95bc266-b6') May 27 21:01:57.916974 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:01:57.916974 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:57.917220 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] VM Paused (Lifecycle Event) May 27 21:01:57.932927 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Took 6.27 seconds to spawn the instance on the hypervisor. May 27 21:01:57.932927 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:58.420811 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:58.423684 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-2b8d34a4-1343-4996-95bb-5fbbe9d16474 req-f589e390-c45c-4ea0-9c7d-a843db95bbb9 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Received event network-vif-plugged-7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:01:58.424742 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-2b8d34a4-1343-4996-95bb-5fbbe9d16474 req-f589e390-c45c-4ea0-9c7d-a843db95bbb9 service nova] Acquiring lock "a6108bdf-d518-447f-927d-43d7fa6456e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:01:58.425124 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-2b8d34a4-1343-4996-95bb-5fbbe9d16474 req-f589e390-c45c-4ea0-9c7d-a843db95bbb9 service nova] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:01:58.425124 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-2b8d34a4-1343-4996-95bb-5fbbe9d16474 req-f589e390-c45c-4ea0-9c7d-a843db95bbb9 service nova] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:58.425339 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-2b8d34a4-1343-4996-95bb-5fbbe9d16474 req-f589e390-c45c-4ea0-9c7d-a843db95bbb9 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] No waiting events found dispatching network-vif-plugged-7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:01:58.425527 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-2b8d34a4-1343-4996-95bb-5fbbe9d16474 req-f589e390-c45c-4ea0-9c7d-a843db95bbb9 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Received unexpected event network-vif-plugged-7cafc030-613a-41b2-9c2a-17b2375b1960 for instance with vm_state active and task_state None. May 27 21:01:58.427005 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:01:58.427205 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] VM Resumed (Lifecycle Event) May 27 21:01:58.447528 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Took 12.46 seconds to build instance. May 27 21:01:58.929588 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:01:58.932230 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:01:58.949951 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d61dfcf-f3d9-4762-8d34-bd997d96c1bc tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.968s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:01:59.424753 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:59.425271 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:01:59.425271 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No VIF found with MAC fa:16:3e:de:c7:fc, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:01:59.425870 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Using config drive May 27 21:01:59.931826 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:00.005463 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9a71a331-b0bd-4786-987e-89e76a725473 req-98c80a1e-743a-4c53-aa26-1c3f0c0ee1b0 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Received event network-changed-7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:00.005463 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9a71a331-b0bd-4786-987e-89e76a725473 req-98c80a1e-743a-4c53-aa26-1c3f0c0ee1b0 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Refreshing instance network info cache due to event network-changed-7cafc030-613a-41b2-9c2a-17b2375b1960. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:00.005798 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9a71a331-b0bd-4786-987e-89e76a725473 req-98c80a1e-743a-4c53-aa26-1c3f0c0ee1b0 service nova] Acquiring lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:00.005956 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9a71a331-b0bd-4786-987e-89e76a725473 req-98c80a1e-743a-4c53-aa26-1c3f0c0ee1b0 service nova] Acquired lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:00.006843 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-9a71a331-b0bd-4786-987e-89e76a725473 req-98c80a1e-743a-4c53-aa26-1c3f0c0ee1b0 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Refreshing network info cache for port 7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:00.056531 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Creating config drive at /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.config May 27 21:02:00.060132 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3266p6h9 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:00.098897 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3266p6h9" returned: 0 in 0.039s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:00.511943 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-9a71a331-b0bd-4786-987e-89e76a725473 req-98c80a1e-743a-4c53-aa26-1c3f0c0ee1b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:00.596128 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:00.623650 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:00.699136 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:00.771195 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:00.773851 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:00.880025 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-68ed8261-9dbb-4017-9a76-1e0071cea509 req-8ac6e816-4136-495d-8551-79394772fa61 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:00.880025 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-68ed8261-9dbb-4017-9a76-1e0071cea509 req-8ac6e816-4136-495d-8551-79394772fa61 service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:00.880025 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-68ed8261-9dbb-4017-9a76-1e0071cea509 req-8ac6e816-4136-495d-8551-79394772fa61 service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:00.880025 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-68ed8261-9dbb-4017-9a76-1e0071cea509 req-8ac6e816-4136-495d-8551-79394772fa61 service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:00.880025 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-68ed8261-9dbb-4017-9a76-1e0071cea509 req-8ac6e816-4136-495d-8551-79394772fa61 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Processing event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:02:00.980930 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-9a71a331-b0bd-4786-987e-89e76a725473 req-98c80a1e-743a-4c53-aa26-1c3f0c0ee1b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:01.150516 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-9a71a331-b0bd-4786-987e-89e76a725473 req-98c80a1e-743a-4c53-aa26-1c3f0c0ee1b0 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Updated VIF entry in instance network info cache for port 7cafc030-613a-41b2-9c2a-17b2375b1960. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:02:01.150882 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-9a71a331-b0bd-4786-987e-89e76a725473 req-98c80a1e-743a-4c53-aa26-1c3f0c0ee1b0 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Updating instance_info_cache with network_info: [{"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:01.389872 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:01.389872 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:01.470438 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:02:01.473595 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:01.473595 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] VM Started (Lifecycle Event) May 27 21:02:01.476837 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:02:01.480380 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Instance spawned successfully. May 27 21:02:01.480821 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:02:01.654313 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9a71a331-b0bd-4786-987e-89e76a725473 req-98c80a1e-743a-4c53-aa26-1c3f0c0ee1b0 service nova] Releasing lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:01.666892 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:01.894712 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:02:01.975592 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:01.981747 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:01.989070 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:01.989220 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:01.989506 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:01.989747 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:01.989997 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:01.990236 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:02.463124 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:02.463124 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:02.466684 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:02:02.466684 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Claim successful on node np0000001553 May 27 21:02:02.483846 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:02:02.483846 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:02.483846 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] VM Paused (Lifecycle Event) May 27 21:02:02.494282 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Took 8.70 seconds to spawn the instance on the hypervisor. May 27 21:02:02.494443 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:02.908558 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:02.951376 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e0ab9638-cf93-4ba7-9709-d4e43a1a8120 req-b5b00d9a-d215-44ec-b0b6-b007efabe2a4 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:02.951504 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e0ab9638-cf93-4ba7-9709-d4e43a1a8120 req-b5b00d9a-d215-44ec-b0b6-b007efabe2a4 service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:02.951635 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e0ab9638-cf93-4ba7-9709-d4e43a1a8120 req-b5b00d9a-d215-44ec-b0b6-b007efabe2a4 service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:02.951803 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e0ab9638-cf93-4ba7-9709-d4e43a1a8120 req-b5b00d9a-d215-44ec-b0b6-b007efabe2a4 service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:02.951841 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e0ab9638-cf93-4ba7-9709-d4e43a1a8120 req-b5b00d9a-d215-44ec-b0b6-b007efabe2a4 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:02.952280 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-e0ab9638-cf93-4ba7-9709-d4e43a1a8120 req-b5b00d9a-d215-44ec-b0b6-b007efabe2a4 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received unexpected event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with vm_state active and task_state None. May 27 21:02:02.985976 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:02.988270 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:02.988270 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] VM Resumed (Lifecycle Event) May 27 21:02:03.005205 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Took 20.18 seconds to build instance. May 27 21:02:03.435298 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:03.491829 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:03.494695 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:03.506990 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6a14e9d6-ac20-45cf-bc3e-d2731b3f8102 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.687s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:03.941109 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] instance snapshotting May 27 21:02:04.050682 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Beginning live snapshot process May 27 21:02:04.182157 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:02:04.182157 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:02:04.684986 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:02:05.136200 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Rescuing May 27 21:02:05.136728 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:05.136728 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquired lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:05.136728 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:02:05.193061 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.730s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:05.193409 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:02:05.563163 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json -f qcow2 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:05.634022 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json -f qcow2" returned: 0 in 0.070s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:05.637166 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json -f qcow2 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:05.643954 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:05.699702 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:02:05.699885 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:02:05.700197 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:05.700384 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:05.713883 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json -f qcow2" returned: 0 in 0.079s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:05.717171 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:05.718362 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:05.719421 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:05.805746 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.083s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:05.805746 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpco0861fc/b9ca21c534e6461e94fb5e9e5bdf3662.delta 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:05.825102 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac9557e825354813ac31afa70f07ffc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251237411f6e4bb49303c88852d6e9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:02:05.843568 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpco0861fc/b9ca21c534e6461e94fb5e9e5bdf3662.delta 1073741824" returned: 0 in 0.039s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:05.844531 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Quiescing instance not available: QEMU guest agent is not enabled. May 27 21:02:06.033356 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:06.140644 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] COPY block job progress, current cursor: 0 final cursor: 76677120 {{(pid=98213) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} May 27 21:02:06.197367 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Updating instance_info_cache with network_info: [{"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:06.202864 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:02:06.484983 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Successfully created port: cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:02:06.643284 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=98213) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} May 27 21:02:06.645112 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Skipping quiescing instance: QEMU guest agent is not enabled. May 27 21:02:06.669963 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:06.690108 np0000001553 nova-compute[98213]: DEBUG nova.privsep.utils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98213) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} May 27 21:02:06.690378 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpco0861fc/b9ca21c534e6461e94fb5e9e5bdf3662.delta /opt/stack/data/nova/instances/snapshots/tmpco0861fc/b9ca21c534e6461e94fb5e9e5bdf3662 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:06.701823 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Releasing lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:06.707722 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:02:06.891761 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpco0861fc/b9ca21c534e6461e94fb5e9e5bdf3662.delta /opt/stack/data/nova/instances/snapshots/tmpco0861fc/b9ca21c534e6461e94fb5e9e5bdf3662" returned: 0 in 0.201s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:06.898005 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Snapshot extracted, beginning image upload May 27 21:02:07.009158 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Successfully updated port: cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:02:07.066077 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6a25f44c-544b-4fa3-9748-dd5bb4d3f042 req-c1648e87-c4aa-447e-a230-686d126b53e5 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Received event network-changed-cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:07.066077 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6a25f44c-544b-4fa3-9748-dd5bb4d3f042 req-c1648e87-c4aa-447e-a230-686d126b53e5 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Refreshing instance network info cache due to event network-changed-cb1be979-cb37-4b4c-a7eb-f327cf20c66c. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:07.066077 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6a25f44c-544b-4fa3-9748-dd5bb4d3f042 req-c1648e87-c4aa-447e-a230-686d126b53e5 service nova] Acquiring lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:07.066077 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6a25f44c-544b-4fa3-9748-dd5bb4d3f042 req-c1648e87-c4aa-447e-a230-686d126b53e5 service nova] Acquired lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:07.066077 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-6a25f44c-544b-4fa3-9748-dd5bb4d3f042 req-c1648e87-c4aa-447e-a230-686d126b53e5 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Refreshing network info cache for port cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:07.512595 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:07.568957 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-6a25f44c-544b-4fa3-9748-dd5bb4d3f042 req-c1648e87-c4aa-447e-a230-686d126b53e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:07.666105 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-6a25f44c-544b-4fa3-9748-dd5bb4d3f042 req-c1648e87-c4aa-447e-a230-686d126b53e5 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:02:07.720302 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:02:07.722965 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:02:07.723496 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Creating image(s) May 27 21:02:07.724261 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "/opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:07.724261 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "/opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:07.724795 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "/opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:07.725456 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:07.728261 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:07.729484 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:07.829071 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.099s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:07.830254 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:07.830864 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:07.831800 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:07.837926 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:07.838579 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:07.890716 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-6a25f44c-544b-4fa3-9748-dd5bb4d3f042 req-c1648e87-c4aa-447e-a230-686d126b53e5 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:07.911519 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:07.931957 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.093s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:07.933086 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:07.994521 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk 1073741824" returned: 0 in 0.061s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:07.994994 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.164s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:07.995365 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:08.100164 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.104s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:08.100775 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:02:08.101126 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:08.195759 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:08.197699 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Cannot resize image /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:02:08.198647 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:02:08.198647 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Ensure instance console log exists: /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:02:08.200418 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:08.201684 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:08.202087 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:08.396277 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6a25f44c-544b-4fa3-9748-dd5bb4d3f042 req-c1648e87-c4aa-447e-a230-686d126b53e5 service nova] Releasing lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:08.396277 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquired lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:08.396277 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:02:08.404250 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:08.409867 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:08.432843 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:08.705399 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:08.717423 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:08.727231 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:08.730274 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999118597999995 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:08.730578 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998302376999845 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:08.730728 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998141328999964 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:08.733542 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:08.735399 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Instance destroyed successfully. May 27 21:02:08.740259 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'numa_topology' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:08.874764 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:08.875024 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:08.978294 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:02:09.145288 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:09.146278 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:09.146278 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:09.146278 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:09.146278 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:09.146278 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received unexpected event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with vm_state active and task_state rescuing. May 27 21:02:09.146278 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:09.146278 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:09.146664 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:09.146949 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:09.147110 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:09.147263 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-c277d73b-619b-4a05-a76f-cec51614629e req-9ef0673d-723b-4614-bc36-ae307a8c866d service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received unexpected event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with vm_state active and task_state rescuing. May 27 21:02:09.177234 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:09.252396 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Attempting a stable device rescue May 27 21:02:09.345514 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Updating instance_info_cache with network_info: [{"id": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "address": "fa:16:3e:9e:34:0a", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1be979-cb", "ovs_interfaceid": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:09.368997 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98213) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} May 27 21:02:09.373666 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Instance directory exists: not creating {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} May 27 21:02:09.374262 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Creating image(s) May 27 21:02:09.374925 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:09.375101 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:09.375687 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:09.375871 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'trusted_certs' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:09.379254 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lazy-loading 'flavor' on Instance uuid 95d3c2a3-6ad3-4458-8771-4f95b37ad16c {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:09.849370 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Releasing lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:09.849755 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Instance network_info: |[{"id": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "address": "fa:16:3e:9e:34:0a", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1be979-cb", "ovs_interfaceid": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:02:09.851977 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Start _get_guest_xml network_info=[{"id": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "address": "fa:16:3e:9e:34:0a", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1be979-cb", "ovs_interfaceid": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:02:09.854042 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:02:09.856029 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='698b750b-959f-4358-b7a0-5f68e76f5a4a'), owner=OwnerMeta(userid='ac9557e825354813ac31afa70f07ffc7', username='tempest-AttachVolumeMultiAttachTest-1088868426-project-member', projectid='251237411f6e4bb49303c88852d6e9a1', projectname='tempest-AttachVolumeMultiAttachTest-1088868426'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "address": "fa:16:3e:9e:34:0a", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1be979-cb", "ovs_interfaceid": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915729.8549905) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:02:09.856491 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:02:09.856959 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:02:09.858400 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:02:09.858400 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:02:09.859220 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:02:09.861945 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:02:09.879213 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='multiattach-server-1',id=12,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-a9vna8h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=698b750b-959f-4358-b7a0-5f68e76f5a4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "address": "fa:16:3e:9e:34:0a", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1be979-cb", "ovs_interfaceid": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:02:09.879213 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "address": "fa:16:3e:9e:34:0a", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1be979-cb", "ovs_interfaceid": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:09.879213 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:0a,bridge_name='br-int',has_traffic_filtering=True,id=cb1be979-cb37-4b4c-a7eb-f327cf20c66c,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1be979-cb') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:09.879929 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'pci_devices' on Instance uuid 698b750b-959f-4358-b7a0-5f68e76f5a4a {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:09.880819 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:09.881171 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "d24520a435eee42b1090a711f2c7f661c0ff160e" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:09.881716 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d24520a435eee42b1090a711f2c7f661c0ff160e" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:10.388049 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] End _get_guest_xml xml= May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 698b750b-959f-4358-b7a0-5f68e76f5a4a May 27 21:02:10.388049 np0000001553 nova-compute[98213]: instance-0000000c May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 196608 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 1 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: multiattach-server-1 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 2026-05-27 21:02:09 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 192 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 1 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 0 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 0 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 1 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: True May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: bare May 27 21:02:10.388049 np0000001553 nova-compute[98213]: qcow2 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 1 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 0 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: virtio May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426-project-member May 27 21:02:10.388049 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:02:10.388049 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 698b750b-959f-4358-b7a0-5f68e76f5a4a May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 698b750b-959f-4358-b7a0-5f68e76f5a4a May 27 21:02:10.388049 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: hvm May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 128 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: 1 May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: Nehalem May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: May 27 21:02:10.388049 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:02:10.390937 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Preparing to wait for external event network-vif-plugged-cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:02:10.390937 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "698b750b-959f-4358-b7a0-5f68e76f5a4a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:10.390937 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:10.390937 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:10.390937 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='multiattach-server-1',id=12,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-a9vna8h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=698b750b-959f-4358-b7a0-5f68e76f5a4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "address": "fa:16:3e:9e:34:0a", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1be979-cb", "ovs_interfaceid": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:02:10.393631 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:10.395224 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "address": "fa:16:3e:9e:34:0a", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1be979-cb", "ovs_interfaceid": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:10.395918 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:0a,bridge_name='br-int',has_traffic_filtering=True,id=cb1be979-cb37-4b4c-a7eb-f327cf20c66c,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1be979-cb') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:10.396267 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:0a,bridge_name='br-int',has_traffic_filtering=True,id=cb1be979-cb37-4b4c-a7eb-f327cf20c66c,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1be979-cb') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:02:10.397199 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:10.397199 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:10.397199 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:02:10.400859 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:10.401215 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecffca87-0fa1-5db9-bf54-c34e06e947de', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:10.405455 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:10.409517 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:10.414227 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:10.414227 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb1be979-cb, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:10.414227 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb1be979-cb, col_values=(('qos', UUID('042f7a96-5338-4d19-8055-6aeafc584125')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:10.414227 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb1be979-cb, col_values=(('external_ids', {'iface-id': 'cb1be979-cb37-4b4c-a7eb-f327cf20c66c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:34:0a', 'vm-uuid': '698b750b-959f-4358-b7a0-5f68e76f5a4a'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:10.416109 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:10.428233 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:10.430776 np0000001553 nova-compute[98213]: INFO os_vif [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:34:0a,bridge_name='br-int',has_traffic_filtering=True,id=cb1be979-cb37-4b4c-a7eb-f327cf20c66c,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb1be979-cb') May 27 21:02:10.734120 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:10.736907 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:10.737288 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e.part --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:10.806348 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e.part --force-share --output=json" returned: 0 in 0.069s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:10.806718 np0000001553 nova-compute[98213]: DEBUG nova.virt.images [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] 2a0cdf24-327d-44ef-aeae-22951006183a was qcow2, converting to raw {{(pid=98213) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} May 27 21:02:10.807357 np0000001553 nova-compute[98213]: DEBUG nova.privsep.utils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98213) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} May 27 21:02:10.807658 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e.part /opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e.converted {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:10.869782 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e.part /opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e.converted" returned: 0 in 0.062s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:10.876373 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e.converted --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:10.958019 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e.converted --force-share --output=json" returned: 0 in 0.083s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:10.958722 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d24520a435eee42b1090a711f2c7f661c0ff160e" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.077s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:10.959229 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:10.967112 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:10.970111 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "d24520a435eee42b1090a711f2c7f661c0ff160e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:10.970912 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d24520a435eee42b1090a711f2c7f661c0ff160e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:10.972401 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:10.980348 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:10.980807 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:11.058489 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e --force-share --output=json" returned: 0 in 0.077s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:11.058964 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e,backing_fmt=raw /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.rescue {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:11.096098 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d24520a435eee42b1090a711f2c7f661c0ff160e,backing_fmt=raw /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.rescue" returned: 0 in 0.037s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:11.097182 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d24520a435eee42b1090a711f2c7f661c0ff160e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.126s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:11.097182 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'migration_context' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:11.601542 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:11.602016 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:02:11.602646 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Start _get_guest_xml network_info=[{"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "vif_mac": "fa:16:3e:de:c7:fc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue={'image_id': '2a0cdf24-327d-44ef-aeae-22951006183a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, 'status': 'reserved', 'instance': 'ee18ee77-6bda-4fb4-ba2b-7a8773411ad4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'serial': 'e465466e-bf1f-44ad-ba71-972248b28143'}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'a2251e70-cd15-4386-a105-74899f2e7325', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:02:11.602896 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'resources' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:11.673820 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:11.910053 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:11.910731 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:11.910731 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Attaching volume a6381228-4020-47cf-9ced-8a33865fb1b8 to /dev/sdc May 27 21:02:11.955090 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:11.955090 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:11.955090 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No VIF found with MAC fa:16:3e:9e:34:0a, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:11.955090 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Using config drive May 27 21:02:11.959599 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:11.975602 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:02:12.003135 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:12.019881 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:12.027674 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.008s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:12.033935 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:02:12.034186 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:02:12.042513 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:02:12.044496 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::b04a:b6ff:fe52:4741', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe82:28ab', 'fe80::8c48:f9ff:fef4:76f6', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe5e:af46', 'fe80::60c7:cff:fed6:aac2', 'fe80::fc16:3eff:fef9:239e', 'fe80::f4a8:7bff:feae:7ec3', 'fe80::fc16:3eff:fe2b:af36', 'fe80::fc16:3eff:fe83:3ad3', 'fe80::f44b:ecff:feb6:e23', 'fe80::fc16:3eff:fe12:51b6'] May 27 21:02:12.044680 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:02:12.044783 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:02:12.045073 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:12.045490 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Updating existing volume attachment record: a13144b9-deb8-45fc-a72b-e5014bc926bc {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:02:12.108572 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:12.113924 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:02:12.115832 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1283714548', uuid='ee18ee77-6bda-4fb4-ba2b-7a8773411ad4'), owner=OwnerMeta(userid='18e30c231082464ab556592986d8b793', username='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member', projectid='79fe4bede0c741bfb93a23985eeef42e', projectname='tempest-ServerBootFromVolumeStableRescueTest-1106755838'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "vif_mac": "fa:16:3e:de:c7:fc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915732.1153095) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:02:12.120055 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:02:12.120568 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:02:12.123696 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:02:12.124153 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:02:12.125396 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:02:12.125789 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:02:12.125995 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:02:12.126127 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:02:12.129381 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:02:12.130260 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:02:12.130406 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:02:12.135578 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:02:12.135696 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:02:12.135876 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:02:12.135989 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:02:12.136221 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:02:12.136603 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:12.145092 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Snapshot image upload complete May 27 21:02:12.145403 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-3a7829ae-cd80-4696-be20-15f9335ce460 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Took 8.20 seconds to snapshot the instance on the hypervisor. May 27 21:02:12.467244 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:12.533014 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lazy-loading 'flavor' on Instance uuid 69083572-b3e6-403a-ae54-6f128a2c88f9 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:12.595419 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Creating config drive at /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk.config May 27 21:02:12.602356 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:02:12.602837 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a6381228-4020-47cf-9ced-8a33865fb1b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:12.602997 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:12.603529 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:12.603707 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a6381228-4020-47cf-9ced-8a33865fb1b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:02:12.607498 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqb0fy6iz {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:12.623444 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:12.624409 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:12.624884 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:12.625668 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:12.630472 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:12.630472 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:12.637716 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:12.637716 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:12.639821 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:12.654301 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:12.654301 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:12.656832 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8] added May 27 21:02:12.656832 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:12.656832 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:12.656832 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:12.656832 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:12.656832 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:12.656832 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:12.664573 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:12.665231 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.04(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:12.668550 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:12.671083 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8] added May 27 21:02:12.671083 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:12.671083 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:12.671083 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:12.671083 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:12.671083 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:12.671083 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:12.671454 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqb0fy6iz" returned: 0 in 0.063s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:12.673545 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:12.673909 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0448(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:12.674054 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:12.676125 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.config --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:12.761357 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.config --force-share --output=json" returned: 0 in 0.085s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:12.762453 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:12.763023 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:12.763958 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:12.765254 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:02:12.765455 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:12.765784 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:13.170833 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:13.209925 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:13.214343 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:13.311907 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:13.396056 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:13.407508 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:13.411868 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d00a1203-d7ef-4d5d-9ee9-d936123432dc req-d3ec8fe2-d598-435b-8853-2807b0f7dc7f service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Received event network-vif-plugged-cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:13.411868 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d00a1203-d7ef-4d5d-9ee9-d936123432dc req-d3ec8fe2-d598-435b-8853-2807b0f7dc7f service nova] Acquiring lock "698b750b-959f-4358-b7a0-5f68e76f5a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:13.411868 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d00a1203-d7ef-4d5d-9ee9-d936123432dc req-d3ec8fe2-d598-435b-8853-2807b0f7dc7f service nova] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:13.411868 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d00a1203-d7ef-4d5d-9ee9-d936123432dc req-d3ec8fe2-d598-435b-8853-2807b0f7dc7f service nova] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:13.412404 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d00a1203-d7ef-4d5d-9ee9-d936123432dc req-d3ec8fe2-d598-435b-8853-2807b0f7dc7f service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Processing event network-vif-plugged-cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:02:13.545409 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:13.671201 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:13.674599 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:13.694257 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:13.694257 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:13.694257 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:13.697033 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:13.697033 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:13.697033 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:13.697033 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:13.717285 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:13.717870 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:13.738595 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.738595 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.738595 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.738595 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.738595 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:13.740066 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.740066 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.740066 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.740066 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.740066 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:13.740433 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.740433 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.740433 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.740433 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.740433 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:13.740726 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.740726 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.740726 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.740726 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.740726 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:13.792537 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8, portal: 192.168.50.100,3260] May 27 21:02:13.792537 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8, portal: 192.168.50.100,3260] successful. May 27 21:02:13.792537 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:13.798560 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8, portal: 192.168.40.100,3260] May 27 21:02:13.798560 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8, portal: 192.168.40.100,3260] successful. May 27 21:02:13.798560 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:13.808127 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:13.815449 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:13.827818 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.827818 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.827818 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.827818 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.827818 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:13.827818 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:13.827818 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:13.828207 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.828207 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.828207 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.828207 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.828207 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:13.828207 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:13.828207 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:13.828492 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:13.828825 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:13.830557 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] HCTL ('11', '-', '-', 0) found on session 7 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:13.830557 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:13.841331 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.841331 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.841331 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.841331 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.841331 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:13.841331 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:13.841331 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:13.841660 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.841660 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:13.841660 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.841660 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:13.841660 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:13.841660 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:13.841660 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:13.842167 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:13.843613 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:13.845320 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] HCTL ('12', '-', '-', 0) found on session 8 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:13.845507 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:13.859129 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Searching for a device in session 7 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:13.859129 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a6381228-4020-47cf-9ced-8a33865fb1b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:13.876274 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Searching for a device in session 8 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:13.876534 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a6381228-4020-47cf-9ced-8a33865fb1b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:14.347714 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:14.351635 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.004s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:14.421299 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:14.421448 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] VM Started (Lifecycle Event) May 27 21:02:14.423220 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:02:14.426794 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:02:14.429332 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Instance spawned successfully. May 27 21:02:14.430661 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:02:14.626582 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:02:14.856982 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'flavor' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:14.924257 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:14.927052 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:14.937385 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:14.937556 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:14.938161 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:14.938477 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:14.938776 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:14.939085 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:15.199931 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:15.200101 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:15.201247 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Attaching volume 961c3d36-44a0-4e83-897a-a18e19c8c262 to /dev/vdb May 27 21:02:15.254415 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:15.265429 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:02:15.293427 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:15.326470 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:02:15.326727 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:02:15.334746 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:02:15.336913 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::b04a:b6ff:fe52:4741', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe82:28ab', 'fe80::8c48:f9ff:fef4:76f6', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe5e:af46', 'fe80::60c7:cff:fed6:aac2', 'fe80::fc16:3eff:fef9:239e', 'fe80::f4a8:7bff:feae:7ec3', 'fe80::fc16:3eff:fe2b:af36', 'fe80::fc16:3eff:fe83:3ad3', 'fe80::f44b:ecff:feb6:e23', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a'] May 27 21:02:15.336913 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:02:15.337092 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:02:15.337364 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:15.337666 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Updating existing volume attachment record: 7f397846-fd34-4b79-a555-5c9699e97ff2 {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:02:15.416977 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:15.431735 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:02:15.432093 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:15.434460 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] VM Paused (Lifecycle Event) May 27 21:02:15.444389 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Took 7.72 seconds to spawn the instance on the hypervisor. May 27 21:02:15.444612 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:15.647480 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Found WWN 330000000f7b0be10 for multipath device dm-4 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:02:15.647927 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:15.648159 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '330000000f7b0be10', 'path': '/dev/dm-4', 'multipath_id': '330000000f7b0be10'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:15.648335 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f7b0be10', 'path': '/dev/dm-4', 'multipath_id': '330000000f7b0be10'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:02:15.649700 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.883s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:15.649700 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:02:15.652261 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lazy-loading 'flavor' on Instance uuid 95d3c2a3-6ad3-4458-8771-4f95b37ad16c {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:15.666879 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:15.667995 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:15.669731 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:15.669731 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:15.670293 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:15.670564 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:15.684433 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:15.684433 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:15.684433 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:15.690777 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:15.690777 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:15.690777 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:15.690777 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:15.695160 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:15.706852 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:15.715656 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:15.715656 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:15.715656 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:15.715656 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:15.715656 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:15.715656 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:15.715656 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:15.715872 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:15.715872 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:15.715872 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:15.715872 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:15.715872 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:15.715872 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:15.715872 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:15.716210 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.047s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:15.716381 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:15.717093 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] HCTL ('9', '0', '0', 0) found on session 5 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:15.717366 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:15.725998 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:15.725998 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:15.725998 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:15.725998 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:15.725998 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:15.725998 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:15.725998 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:15.726346 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:15.726346 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:15.726346 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:15.726346 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:15.726346 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:15.726346 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:15.726346 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:15.726529 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:15.726703 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:15.727578 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching for a device in session 5 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:15.727578 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:15.728027 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] HCTL ('10', '0', '0', 0) found on session 6 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:15.728208 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:15.736907 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching for a device in session 6 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:15.737214 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:15.865781 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.514s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:15.884718 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-61e62074-f985-4d5f-b5f4-f3d0ef17ee35 req-de40c14d-9c41-4ad4-9b4b-4dd5af7463b8 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Received event network-vif-plugged-cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:15.884869 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-61e62074-f985-4d5f-b5f4-f3d0ef17ee35 req-de40c14d-9c41-4ad4-9b4b-4dd5af7463b8 service nova] Acquiring lock "698b750b-959f-4358-b7a0-5f68e76f5a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:15.885056 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-61e62074-f985-4d5f-b5f4-f3d0ef17ee35 req-de40c14d-9c41-4ad4-9b4b-4dd5af7463b8 service nova] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:15.885250 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-61e62074-f985-4d5f-b5f4-f3d0ef17ee35 req-de40c14d-9c41-4ad4-9b4b-4dd5af7463b8 service nova] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:15.885432 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-61e62074-f985-4d5f-b5f4-f3d0ef17ee35 req-de40c14d-9c41-4ad4-9b4b-4dd5af7463b8 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] No waiting events found dispatching network-vif-plugged-cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:15.885616 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-61e62074-f985-4d5f-b5f4-f3d0ef17ee35 req-de40c14d-9c41-4ad4-9b4b-4dd5af7463b8 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Received unexpected event network-vif-plugged-cb1be979-cb37-4b4c-a7eb-f327cf20c66c for instance with vm_state active and task_state None. May 27 21:02:15.914024 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:02:15.914459 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '961c3d36-44a0-4e83-897a-a18e19c8c262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:15.914654 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:15.935740 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:15.938913 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:15.939086 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] VM Resumed (Lifecycle Event) May 27 21:02:15.955097 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Took 13.56 seconds to build instance. May 27 21:02:16.159226 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] attach device xml: May 27 21:02:16.159226 np0000001553 nova-compute[98213]: May 27 21:02:16.159226 np0000001553 nova-compute[98213]: May 27 21:02:16.159226 np0000001553 nova-compute[98213]: May 27 21:02:16.159226 np0000001553 nova-compute[98213]: May 27 21:02:16.159226 np0000001553 nova-compute[98213]: a6381228-4020-47cf-9ced-8a33865fb1b8 May 27 21:02:16.159226 np0000001553 nova-compute[98213]:
May 27 21:02:16.159226 np0000001553 nova-compute[98213]: May 27 21:02:16.159226 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:02:16.442199 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:16.445212 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:16.457565 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-efe16b49-7877-4c7d-a2f4-8338f617b8c3 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.068s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:16.671054 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:02:16.678014 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:16.871165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:16.871165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:17.300492 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:17.300646 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:17.300827 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Attaching volume aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 to /dev/vdb May 27 21:02:17.341545 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:17.353611 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:02:17.374486 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:02:17.378636 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:17.417604 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:02:17.419427 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:02:17.428838 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:02:17.430571 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::b04a:b6ff:fe52:4741', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe82:28ab', 'fe80::8c48:f9ff:fef4:76f6', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe5e:af46', 'fe80::60c7:cff:fed6:aac2', 'fe80::fc16:3eff:fef9:239e', 'fe80::f4a8:7bff:feae:7ec3', 'fe80::fc16:3eff:fe2b:af36', 'fe80::fc16:3eff:fe83:3ad3', 'fe80::f44b:ecff:feb6:e23', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a'] May 27 21:02:17.433421 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:02:17.433546 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:02:17.433824 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:17.434088 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updating existing volume attachment record: e467441e-b815-4287-99fb-b5f4658b286d {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:02:17.522605 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-943bf015-bb3c-4e9b-9bfb-729e988d45ae req-07975b70-1cb9-455b-b5a3-d1ed7e24f776 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Received event network-changed-7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:17.523054 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-943bf015-bb3c-4e9b-9bfb-729e988d45ae req-07975b70-1cb9-455b-b5a3-d1ed7e24f776 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Refreshing instance network info cache due to event network-changed-7cafc030-613a-41b2-9c2a-17b2375b1960. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:17.526162 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-943bf015-bb3c-4e9b-9bfb-729e988d45ae req-07975b70-1cb9-455b-b5a3-d1ed7e24f776 service nova] Acquiring lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:17.526312 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-943bf015-bb3c-4e9b-9bfb-729e988d45ae req-07975b70-1cb9-455b-b5a3-d1ed7e24f776 service nova] Acquired lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:17.526489 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-943bf015-bb3c-4e9b-9bfb-729e988d45ae req-07975b70-1cb9-455b-b5a3-d1ed7e24f776 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Refreshing network info cache for port 7cafc030-613a-41b2-9c2a-17b2375b1960 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:17.687677 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Found WWN 33000000021da23ae for multipath device dm-3 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:02:17.688207 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.039s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:17.688445 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] <== connect_volume: return (4922ms) {'type': 'block', 'scsi_wwn': '33000000021da23ae', 'path': '/dev/dm-3', 'multipath_id': '33000000021da23ae'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:17.688605 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000021da23ae', 'path': '/dev/dm-3', 'multipath_id': '33000000021da23ae'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:02:17.689573 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.775s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:17.689861 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '961c3d36-44a0-4e83-897a-a18e19c8c262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:02:17.705503 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:17.705503 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:17.705503 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:17.705503 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:17.705771 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:17.705914 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:17.717123 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:17.717123 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:17.721534 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:17.721534 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:17.728813 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262] added May 27 21:02:17.728813 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:17.728813 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:17.728813 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:17.728813 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:17.728813 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:17.728813 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:17.728813 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:17.732364 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0236(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:17.732364 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:17.733420 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262] added May 27 21:02:17.733420 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:17.733420 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:17.733420 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:17.733420 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:17.733420 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:17.733420 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:17.733633 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:17.733753 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:17.733905 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:17.849299 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] No BDM found with device name sda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:17.849443 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:17.849564 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:17.849688 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] No VIF found with MAC fa:16:3e:82:28:ab, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:17.941617 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:17.941927 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:17.945336 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:02:17.945529 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Claim successful on node np0000001553 May 27 21:02:18.031077 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-943bf015-bb3c-4e9b-9bfb-729e988d45ae req-07975b70-1cb9-455b-b5a3-d1ed7e24f776 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:18.129990 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:02:18.130359 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:18.130511 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:18.201283 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1283714548',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-1283714548',id=10,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:02:02Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-xdon22jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:03Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=ee18ee77-6bda-4fb4-ba2b-7a8773411ad4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "vif_mac": "fa:16:3e:de:c7:fc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:02:18.201587 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "vif_mac": "fa:16:3e:de:c7:fc"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:18.202368 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=f95bc266-b629-40ae-8a9b-8b0df38a03f8,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95bc266-b6') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:18.203160 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'pci_devices' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:18.367988 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-943bf015-bb3c-4e9b-9bfb-729e988d45ae req-07975b70-1cb9-455b-b5a3-d1ed7e24f776 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:18.498560 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-943bf015-bb3c-4e9b-9bfb-729e988d45ae req-07975b70-1cb9-455b-b5a3-d1ed7e24f776 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Updated VIF entry in instance network info cache for port 7cafc030-613a-41b2-9c2a-17b2375b1960. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:02:18.498932 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-943bf015-bb3c-4e9b-9bfb-729e988d45ae req-07975b70-1cb9-455b-b5a3-d1ed7e24f776 service nova] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Updating instance_info_cache with network_info: [{"id": "7cafc030-613a-41b2-9c2a-17b2375b1960", "address": "fa:16:3e:12:51:b6", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cafc030-61", "ovs_interfaceid": "7cafc030-613a-41b2-9c2a-17b2375b1960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:18.706339 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:18.707337 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] End _get_guest_xml xml= May 27 21:02:18.707337 np0000001553 nova-compute[98213]: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: instance-0000000a May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 196608 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 1 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-server-1283714548 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 2026-05-27 21:02:12 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 192 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 1 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 0 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 0 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 1 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: True May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: bare May 27 21:02:18.707337 np0000001553 nova-compute[98213]: qcow2 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 1 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 0 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: ide May 27 21:02:18.707337 np0000001553 nova-compute[98213]: virtio May 27 21:02:18.707337 np0000001553 nova-compute[98213]: pc May 27 21:02:18.707337 np0000001553 nova-compute[98213]: virtio May 27 21:02:18.707337 np0000001553 nova-compute[98213]: virtio May 27 21:02:18.707337 np0000001553 nova-compute[98213]: virtio May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member May 27 21:02:18.707337 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:02:18.707337 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: hvm May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 128 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: 1 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: Nehalem May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: e465466e-bf1f-44ad-ba71-972248b28143 May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: May 27 21:02:18.707337 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:02:18.711581 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Instance destroyed successfully. May 27 21:02:18.729432 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:18.734597 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:18.742321 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:18.742321 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:18.742321 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:18.748651 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:18.748651 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:18.748651 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:18.748651 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:18.754297 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:18.761297 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:18.772327 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.772327 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.772327 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.772327 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.772327 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.772327 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.772327 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:18.772588 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.772588 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.772588 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.772588 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.772588 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.772588 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.772588 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:18.777543 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.777543 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.777543 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.777543 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.777543 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.777543 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.777543 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:18.777769 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.777769 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.777769 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.777769 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.777769 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.777769 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.777769 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:18.810086 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262, portal: 192.168.40.100,3260] May 27 21:02:18.810086 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262, portal: 192.168.40.100,3260] successful. May 27 21:02:18.810086 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:18.817407 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262, portal: 192.168.50.100,3260] May 27 21:02:18.817407 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262, portal: 192.168.50.100,3260] successful. May 27 21:02:18.817407 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:18.821991 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:18.828792 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:18.836533 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:18.836533 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.836533 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.836533 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.836533 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.836533 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.836533 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.836533 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:18.836533 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:18.836797 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:18.836797 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.836797 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.836797 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.836797 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.836797 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.836797 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.836797 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:18.836797 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:18.837012 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:18.837161 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:18.838719 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] HCTL ('13', '-', '-', 0) found on session 9 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:18.838916 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Scanning host 13 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:18.846366 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:18.846366 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.846366 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.846366 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.846366 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.846366 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.846366 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.846366 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:18.846366 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:18.846596 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:18.846596 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.846596 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:18.846596 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.846596 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:18.846596 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.846596 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:18.846596 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:18.846596 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:18.846747 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:18.846889 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:18.847892 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] HCTL ('14', '-', '-', 0) found on session 10 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:18.848047 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Scanning host 14 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:18.854005 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Searching for a device in session 9 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:18.855313 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '961c3d36-44a0-4e83-897a-a18e19c8c262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:18.865248 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Searching for a device in session 10 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:18.865248 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '961c3d36-44a0-4e83-897a-a18e19c8c262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:19.002435 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-943bf015-bb3c-4e9b-9bfb-729e988d45ae req-07975b70-1cb9-455b-b5a3-d1ed7e24f776 service nova] Releasing lock "refresh_cache-a6108bdf-d518-447f-927d-43d7fa6456e2" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:19.297086 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "a6108bdf-d518-447f-927d-43d7fa6456e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:19.297281 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:19.406349 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8eb58f9b-481d-46ac-b1ec-fc32d8c8e5fa tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.496s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:19.590719 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-bb50c243-bab1-4cc9-a2f6-a5841411d3eb req-84b436af-d7c6-4f06-a435-1386c5f9a8dd service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Received event network-changed-cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:19.590903 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-bb50c243-bab1-4cc9-a2f6-a5841411d3eb req-84b436af-d7c6-4f06-a435-1386c5f9a8dd service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Refreshing instance network info cache due to event network-changed-cb1be979-cb37-4b4c-a7eb-f327cf20c66c. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:19.591112 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-bb50c243-bab1-4cc9-a2f6-a5841411d3eb req-84b436af-d7c6-4f06-a435-1386c5f9a8dd service nova] Acquiring lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:19.591443 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-bb50c243-bab1-4cc9-a2f6-a5841411d3eb req-84b436af-d7c6-4f06-a435-1386c5f9a8dd service nova] Acquired lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:19.591598 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-bb50c243-bab1-4cc9-a2f6-a5841411d3eb req-84b436af-d7c6-4f06-a435-1386c5f9a8dd service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Refreshing network info cache for port cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:19.629445 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:02:19.629649 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:02:19.705814 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:02:19.805572 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'flavor' on Instance uuid a6108bdf-d518-447f-927d-43d7fa6456e2 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:20.016916 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:20.017102 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:20.093999 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-bb50c243-bab1-4cc9-a2f6-a5841411d3eb req-84b436af-d7c6-4f06-a435-1386c5f9a8dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:20.132473 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:02:20.226177 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:20.226353 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:20.226492 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:20.226626 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No VIF found with MAC fa:16:3e:de:c7:fc, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:20.227205 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Using config drive May 27 21:02:20.420530 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:20.453669 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-bb50c243-bab1-4cc9-a2f6-a5841411d3eb req-84b436af-d7c6-4f06-a435-1386c5f9a8dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:20.519438 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Detaching volume a6381228-4020-47cf-9ced-8a33865fb1b8 May 27 21:02:20.572957 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Attempting to driver detach volume a6381228-4020-47cf-9ced-8a33865fb1b8 from mountpoint /dev/sdc May 27 21:02:20.577161 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Found disk sdc by alias ua-a6381228-4020-47cf-9ced-8a33865fb1b8 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:20.578445 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Found disk sdc by alias ua-a6381228-4020-47cf-9ced-8a33865fb1b8 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:20.578611 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Attempting to detach device sdc from instance 95d3c2a3-6ad3-4458-8771-4f95b37ad16c from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:02:20.578930 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] detach device xml: May 27 21:02:20.578930 np0000001553 nova-compute[98213]: May 27 21:02:20.578930 np0000001553 nova-compute[98213]: May 27 21:02:20.578930 np0000001553 nova-compute[98213]: May 27 21:02:20.578930 np0000001553 nova-compute[98213]: May 27 21:02:20.578930 np0000001553 nova-compute[98213]: a6381228-4020-47cf-9ced-8a33865fb1b8 May 27 21:02:20.578930 np0000001553 nova-compute[98213]:
May 27 21:02:20.578930 np0000001553 nova-compute[98213]: May 27 21:02:20.578930 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:20.587261 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Successfully detached device sdc from instance 95d3c2a3-6ad3-4458-8771-4f95b37ad16c from the persistent domain config. May 27 21:02:20.588133 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] (1/8): Attempting to detach device sdc with device alias ua-a6381228-4020-47cf-9ced-8a33865fb1b8 from instance 95d3c2a3-6ad3-4458-8771-4f95b37ad16c from the live domain config. {{(pid=98213) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} May 27 21:02:20.588133 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] detach device xml: May 27 21:02:20.588133 np0000001553 nova-compute[98213]: May 27 21:02:20.588133 np0000001553 nova-compute[98213]: May 27 21:02:20.588133 np0000001553 nova-compute[98213]: May 27 21:02:20.588133 np0000001553 nova-compute[98213]: May 27 21:02:20.588133 np0000001553 nova-compute[98213]: a6381228-4020-47cf-9ced-8a33865fb1b8 May 27 21:02:20.588133 np0000001553 nova-compute[98213]:
May 27 21:02:20.588133 np0000001553 nova-compute[98213]: May 27 21:02:20.588133 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:20.640679 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-bb50c243-bab1-4cc9-a2f6-a5841411d3eb req-84b436af-d7c6-4f06-a435-1386c5f9a8dd service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Updated VIF entry in instance network info cache for port cb1be979-cb37-4b4c-a7eb-f327cf20c66c. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:02:20.640679 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-bb50c243-bab1-4cc9-a2f6-a5841411d3eb req-84b436af-d7c6-4f06-a435-1386c5f9a8dd service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Updating instance_info_cache with network_info: [{"id": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "address": "fa:16:3e:9e:34:0a", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1be979-cb", "ovs_interfaceid": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:20.643516 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.701s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:20.644245 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:02:20.726981 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Found WWN 330000000adddd7d6 for multipath device dm-5 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:02:20.727342 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:20.727910 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] <== connect_volume: return (4813ms) {'type': 'block', 'scsi_wwn': '330000000adddd7d6', 'path': '/dev/dm-5', 'multipath_id': '330000000adddd7d6'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:20.728345 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000adddd7d6', 'path': '/dev/dm-5', 'multipath_id': '330000000adddd7d6'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:02:20.728721 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.598s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:20.728964 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:02:20.734310 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'ec2_ids' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:20.743024 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lazy-loading 'flavor' on Instance uuid 69083572-b3e6-403a-ae54-6f128a2c88f9 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:20.746526 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:20.753044 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:20.753044 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:20.753044 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:20.753044 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:20.753044 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:20.760643 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:20.760643 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:20.767567 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:20.767567 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:20.776915 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1] added May 27 21:02:20.776915 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:20.776915 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:20.776915 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:20.776915 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:20.776915 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:20.776915 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:20.777426 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:20.777482 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:20.777592 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:20.782308 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1] added May 27 21:02:20.782308 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:20.782308 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:20.782308 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:20.782308 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:20.782308 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:20.782308 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:20.782547 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:20.782622 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:20.782743 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:20.783862 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Received event ua-a6381228-4020-47cf-9ced-8a33865fb1b8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98213) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} May 27 21:02:20.785956 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-a6381228-4020-47cf-9ced-8a33865fb1b8 for instance 95d3c2a3-6ad3-4458-8771-4f95b37ad16c {{(pid=98213) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} May 27 21:02:20.790949 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Successfully detached device sdc from instance 95d3c2a3-6ad3-4458-8771-4f95b37ad16c from the live domain config. May 27 21:02:20.792037 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:02:20.792378 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a6381228-4020-47cf-9ced-8a33865fb1b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:20.792493 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:20.811067 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.514s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:21.004852 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c47aeae5-bb66-4029-a438-f8b823865c43 req-86bc58e0-4e03-4332-a1c8-30270901029a service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Received event network-changed-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:21.005017 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c47aeae5-bb66-4029-a438-f8b823865c43 req-86bc58e0-4e03-4332-a1c8-30270901029a service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Refreshing instance network info cache due to event network-changed-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:21.005236 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c47aeae5-bb66-4029-a438-f8b823865c43 req-86bc58e0-4e03-4332-a1c8-30270901029a service nova] Acquiring lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:21.005375 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c47aeae5-bb66-4029-a438-f8b823865c43 req-86bc58e0-4e03-4332-a1c8-30270901029a service nova] Acquired lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:21.005545 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-c47aeae5-bb66-4029-a438-f8b823865c43 req-86bc58e0-4e03-4332-a1c8-30270901029a service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Refreshing network info cache for port f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:21.142864 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-bb50c243-bab1-4cc9-a2f6-a5841411d3eb req-84b436af-d7c6-4f06-a435-1386c5f9a8dd service nova] Releasing lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:21.151950 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:02:21.155174 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:02:21.155174 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:21.155174 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:21.241926 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:21.242330 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'keypairs' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:21.246232 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Attempting to attach volume 961c3d36-44a0-4e83-897a-a18e19c8c262 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:02:21.247457 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] attach device xml: May 27 21:02:21.247457 np0000001553 nova-compute[98213]: May 27 21:02:21.247457 np0000001553 nova-compute[98213]: May 27 21:02:21.247457 np0000001553 nova-compute[98213]: May 27 21:02:21.247457 np0000001553 nova-compute[98213]: May 27 21:02:21.247457 np0000001553 nova-compute[98213]: 961c3d36-44a0-4e83-897a-a18e19c8c262 May 27 21:02:21.247457 np0000001553 nova-compute[98213]: May 27 21:02:21.247457 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:02:21.251612 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99659c2947e743c899512883f5a85b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562b6a1ba2b4c3ab101af22f9d04713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:02:21.508204 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-c47aeae5-bb66-4029-a438-f8b823865c43 req-86bc58e0-4e03-4332-a1c8-30270901029a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:21.653472 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:02:21.680834 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:21.745404 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:21.751215 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:21.779594 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Successfully created port: a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:02:21.781154 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:21.783214 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:21.794114 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:21.794114 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:21.794114 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:21.805343 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:21.805343 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:21.805343 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:21.805343 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:21.811320 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:21.818731 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:21.829009 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:21.829009 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.829009 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:21.843863 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.843863 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.843863 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.843863 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.843863 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.843863 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.843863 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.843863 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.843863 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:21.844106 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.844106 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.844106 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.844106 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.844106 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.844106 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.844106 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.844106 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.844106 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:21.869522 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1, portal: 192.168.40.100,3260] May 27 21:02:21.869522 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1, portal: 192.168.40.100,3260] successful. May 27 21:02:21.869522 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:21.898475 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:21.912562 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "a6108bdf-d518-447f-927d-43d7fa6456e2" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:21.912801 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:21.913042 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Attaching volume d6a1fc42-6b17-46f6-b4f0-a605fb6da369 to /dev/vdb May 27 21:02:21.921741 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1, portal: 192.168.50.100,3260] May 27 21:02:21.921741 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1, portal: 192.168.50.100,3260] successful. May 27 21:02:21.921741 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:21.929946 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-c47aeae5-bb66-4029-a438-f8b823865c43 req-86bc58e0-4e03-4332-a1c8-30270901029a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:21.932952 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.932952 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:21.932952 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:21.932952 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.932952 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.932952 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.932952 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.932952 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.932952 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.932952 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.932952 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:21.935288 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.935288 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:21.935288 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:21.935288 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.935288 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.935288 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.935288 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.935288 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.935288 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.935288 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.935288 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:21.938420 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:21.938589 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:21.940789 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] HCTL ('15', '-', '-', 0) found on session 11 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:21.940934 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:21.944434 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:21.958802 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Creating config drive at /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.config.rescue May 27 21:02:21.962390 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Searching for a device in session 11 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:21.962557 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:21.965123 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx030ysra {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:21.981009 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.981009 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:21.981009 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:21.981009 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.981009 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.981009 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.981009 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.981009 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.981009 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.981009 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.981009 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:21.981306 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.981306 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:21.981306 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:21.981306 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.981306 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:21.981306 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.981306 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:21.981306 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.981306 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:21.981306 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:21.981306 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:21.982396 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.235s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:21.982613 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:21.990400 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] HCTL ('16', '-', '-', 0) found on session 12 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:21.990636 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:21.993542 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:22.000574 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:22.001069 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.007s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:22.010063 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Searching for a device in session 12 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:22.010448 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:22.013364 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx030ysra" returned: 0 in 0.048s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:22.017455 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:02:22.049011 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:22.081258 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:02:22.081655 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:02:22.091706 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:02:22.093258 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::b04a:b6ff:fe52:4741', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe82:28ab', 'fe80::8c48:f9ff:fef4:76f6', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe5e:af46', 'fe80::60c7:cff:fed6:aac2', 'fe80::fc16:3eff:fef9:239e', 'fe80::f4a8:7bff:feae:7ec3', 'fe80::fc16:3eff:fe2b:af36', 'fe80::fc16:3eff:fe83:3ad3', 'fe80::f44b:ecff:feb6:e23', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a'] May 27 21:02:22.093401 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:02:22.093401 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:02:22.093592 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:22.093837 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Updating existing volume attachment record: 824c4b73-2344-4589-9300-23bb87ea7adb {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:02:22.158764 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:02:22.177191 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-c47aeae5-bb66-4029-a438-f8b823865c43 req-86bc58e0-4e03-4332-a1c8-30270901029a service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Updated VIF entry in instance network info cache for port f22d5bf5-4ec9-44c2-956b-553ed90ce5c4. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:02:22.177191 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-c47aeae5-bb66-4029-a438-f8b823865c43 req-86bc58e0-4e03-4332-a1c8-30270901029a service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Updating instance_info_cache with network_info: [{"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:22.401281 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Successfully updated port: a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:02:22.465875 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-2f8dd66d-5f1d-4973-a2e6-7841a13af25f req-abebf3e1-a1b2-4e5d-bcb2-5b66b5b7fb84 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-changed-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:22.466332 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-2f8dd66d-5f1d-4973-a2e6-7841a13af25f req-abebf3e1-a1b2-4e5d-bcb2-5b66b5b7fb84 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Refreshing instance network info cache due to event network-changed-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:22.466579 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-2f8dd66d-5f1d-4973-a2e6-7841a13af25f req-abebf3e1-a1b2-4e5d-bcb2-5b66b5b7fb84 service nova] Acquiring lock "refresh_cache-a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:22.466701 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-2f8dd66d-5f1d-4973-a2e6-7841a13af25f req-abebf3e1-a1b2-4e5d-bcb2-5b66b5b7fb84 service nova] Acquired lock "refresh_cache-a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:22.466880 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-2f8dd66d-5f1d-4973-a2e6-7841a13af25f req-abebf3e1-a1b2-4e5d-bcb2-5b66b5b7fb84 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Refreshing network info cache for port a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:22.506909 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:22.512249 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lazy-loading 'flavor' on Instance uuid aac9c5e0-da16-44ef-b255-53b21d0cc63d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:22.536085 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:22.539688 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:22.637829 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:22.671231 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:02:22.671732 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:22.671931 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:22.681367 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c47aeae5-bb66-4029-a438-f8b823865c43 req-86bc58e0-4e03-4332-a1c8-30270901029a service nova] Releasing lock "refresh_cache-d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:22.692170 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:22.695195 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:22.758352 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:02:22.905396 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "refresh_cache-a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:22.947291 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:22.947407 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:22.947525 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:22.947589 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] No VIF found with MAC fa:16:3e:5e:af:46, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:22.970489 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-2f8dd66d-5f1d-4973-a2e6-7841a13af25f req-abebf3e1-a1b2-4e5d-bcb2-5b66b5b7fb84 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:23.068069 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-2f8dd66d-5f1d-4973-a2e6-7841a13af25f req-abebf3e1-a1b2-4e5d-bcb2-5b66b5b7fb84 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:02:23.077271 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-1b76ee8e-cd62-4eeb-8fbb-42b0db2db218 req-7f33aef9-ec3b-4ca9-8943-2f17b943089d service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Received event network-changed-d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:23.077271 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-1b76ee8e-cd62-4eeb-8fbb-42b0db2db218 req-7f33aef9-ec3b-4ca9-8943-2f17b943089d service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Refreshing instance network info cache due to event network-changed-d60a0341-d711-4a9b-83bb-cad3bf479f30. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:23.077271 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-1b76ee8e-cd62-4eeb-8fbb-42b0db2db218 req-7f33aef9-ec3b-4ca9-8943-2f17b943089d service nova] Acquiring lock "refresh_cache-aac9c5e0-da16-44ef-b255-53b21d0cc63d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:23.077271 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-1b76ee8e-cd62-4eeb-8fbb-42b0db2db218 req-7f33aef9-ec3b-4ca9-8943-2f17b943089d service nova] Acquired lock "refresh_cache-aac9c5e0-da16-44ef-b255-53b21d0cc63d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:23.077271 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-1b76ee8e-cd62-4eeb-8fbb-42b0db2db218 req-7f33aef9-ec3b-4ca9-8943-2f17b943089d service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Refreshing network info cache for port d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:23.171916 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:02:23.173305 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:02:23.173305 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Creating image(s) May 27 21:02:23.173729 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:23.173942 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "/opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:23.174566 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "/opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:23.175134 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:23.182495 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:23.182495 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:23.232480 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-2f8dd66d-5f1d-4973-a2e6-7841a13af25f req-abebf3e1-a1b2-4e5d-bcb2-5b66b5b7fb84 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:23.259356 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.077s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:23.260028 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:23.260614 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:23.261243 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:23.266272 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:23.266914 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:23.346170 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.079s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:23.346815 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:23.378385 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:02:23.379305 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:23.379474 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] VM Resumed (Lifecycle Event) May 27 21:02:23.385572 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-7d024faa-5dc1-4d04-8a6c-4c79f0217a13 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:23.391649 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk 1073741824" returned: 0 in 0.045s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:23.392041 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.131s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:23.392395 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:23.468838 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.076s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:23.469268 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:02:23.469502 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:23.521894 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.521s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:23.542591 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:23.543048 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Cannot resize image /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:02:23.543512 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:02:23.543751 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Ensure instance console log exists: /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:02:23.544094 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:23.544350 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:23.544521 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:23.581088 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-1b76ee8e-cd62-4eeb-8fbb-42b0db2db218 req-7f33aef9-ec3b-4ca9-8943-2f17b943089d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:23.731673 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00047226100014086114 future=) was cancelled during its delay period, skipping {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:23.731673 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:23.737106 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-2f8dd66d-5f1d-4973-a2e6-7841a13af25f req-abebf3e1-a1b2-4e5d-bcb2-5b66b5b7fb84 service nova] Releasing lock "refresh_cache-a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:23.737544 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquired lock "refresh_cache-a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:23.737661 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:02:23.778218 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Found WWN 330000000e3776757 for multipath device dm-6 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:02:23.778769 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:23.779102 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] <== connect_volume: return (5648ms) {'type': 'block', 'scsi_wwn': '330000000e3776757', 'path': '/dev/dm-6', 'multipath_id': '330000000e3776757'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:23.779333 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e3776757', 'path': '/dev/dm-6', 'multipath_id': '330000000e3776757'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:02:23.779655 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.987s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:23.780094 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a6381228-4020-47cf-9ced-8a33865fb1b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:02:23.780299 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:02:23.782018 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'flavor' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:23.807307 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:23.807307 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:23.807307 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:23.807307 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:23.807307 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:23.807307 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:23.807307 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:23.807307 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:23.807307 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:23.807307 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:23.807307 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:23.807611 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:23.807611 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:23.807611 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:23.807611 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:23.807611 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:23.807611 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:23.807611 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:23.807611 np0000001553 nova-compute[98213]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:23.807611 np0000001553 nova-compute[98213]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8 (non-flash) May 27 21:02:23.807611 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:23.807611 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:23.807611 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', '9')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:02:23.807894 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', '8')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:02:23.809955 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8', '7')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:02:23.810954 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Resulting device map defaultdict(. at 0x79ced0190c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8'): ({'sdf'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:02:23.811562 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Removing multipathed devices sdf, sdg {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:02:23.811833 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Flush multipath device 330000000f7b0be10 {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:02:23.844397 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:02:23.873848 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-1b76ee8e-cd62-4eeb-8fbb-42b0db2db218 req-7f33aef9-ec3b-4ca9-8943-2f17b943089d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:23.885325 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:23.886516 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:23.894961 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:02:23.936911 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:02:23.937287 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:02:23.938914 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:02:23.949556 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:02:23.949724 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:02:23.962215 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:24.012896 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8, portal: 192.168.40.100,3260] May 27 21:02:24.012896 np0000001553 nova-compute[98213]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8, portal: 192.168.40.100,3260] successful. May 27 21:02:24.012896 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:24.032302 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:24.035022 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-1b76ee8e-cd62-4eeb-8fbb-42b0db2db218 req-7f33aef9-ec3b-4ca9-8943-2f17b943089d service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Updated VIF entry in instance network info cache for port d60a0341-d711-4a9b-83bb-cad3bf479f30. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:02:24.036353 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-1b76ee8e-cd62-4eeb-8fbb-42b0db2db218 req-7f33aef9-ec3b-4ca9-8943-2f17b943089d service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Updating instance_info_cache with network_info: [{"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:24.046733 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:24.082255 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8, portal: 192.168.50.100,3260] May 27 21:02:24.082255 np0000001553 nova-compute[98213]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-a6381228-4020-47cf-9ced-8a33865fb1b8, portal: 192.168.50.100,3260] successful. May 27 21:02:24.082255 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:24.100328 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:24.100643 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:24.101264 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] <== disconnect_volume: return (3308ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:24.101458 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:02:24.101785 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.429s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:24.102024 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:02:24.114741 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:24.115502 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:24.117511 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:24.117852 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:24.118583 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:24.119585 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:24.129261 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:24.129261 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:24.135223 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:24.135223 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:24.141897 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369] added May 27 21:02:24.141897 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:24.141897 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:24.141897 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:24.141897 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:24.141897 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:24.141897 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:24.142099 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:24.142883 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:24.142883 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:24.148995 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369] added May 27 21:02:24.148995 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:24.148995 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:24.148995 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:24.148995 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:24.148995 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:24.148995 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:24.149253 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:24.149515 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:24.149717 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:24.285395 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Attempting to attach volume aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:02:24.286399 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] attach device xml: May 27 21:02:24.286399 np0000001553 nova-compute[98213]: May 27 21:02:24.286399 np0000001553 nova-compute[98213]: May 27 21:02:24.286399 np0000001553 nova-compute[98213]: May 27 21:02:24.286399 np0000001553 nova-compute[98213]: May 27 21:02:24.286399 np0000001553 nova-compute[98213]: aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 May 27 21:02:24.286399 np0000001553 nova-compute[98213]: May 27 21:02:24.286399 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:02:24.317323 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:02:24.389552 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:24.389700 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] VM Started (Lifecycle Event) May 27 21:02:24.493893 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:24.524700 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-68dd8499-613d-4388-988d-f76ad6dd2371 tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.324s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:24.541753 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-1b76ee8e-cd62-4eeb-8fbb-42b0db2db218 req-7f33aef9-ec3b-4ca9-8943-2f17b943089d service nova] Releasing lock "refresh_cache-aac9c5e0-da16-44ef-b255-53b21d0cc63d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:24.571218 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:24.571218 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:24.571218 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Attaching volume 5e75d999-c6d6-489b-8483-5f3a34c5b898 to /dev/vdb May 27 21:02:24.626757 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:24.643884 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:02:24.656309 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:24.658849 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:24.659024 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:24.659024 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:24.659178 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:24.659310 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received unexpected event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:24.659354 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:24.659452 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:24.659563 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:24.659648 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:24.659770 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:24.659860 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-a4a433c7-90b8-483b-a2e0-f46f45edb459 req-c2bdc0a0-b949-447b-9697-3c08c99b700f service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received unexpected event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:24.665126 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:24.693980 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:02:24.694449 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:02:24.704121 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:02:24.705654 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::b04a:b6ff:fe52:4741', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe82:28ab', 'fe80::8c48:f9ff:fef4:76f6', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe5e:af46', 'fe80::60c7:cff:fed6:aac2', 'fe80::fc16:3eff:fef9:239e', 'fe80::f4a8:7bff:feae:7ec3', 'fe80::fc16:3eff:fe2b:af36', 'fe80::fc16:3eff:fe83:3ad3', 'fe80::f44b:ecff:feb6:e23', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc'] May 27 21:02:24.705807 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:02:24.705896 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:02:24.706127 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:24.706547 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Updating existing volume attachment record: 7fbe6fac-4f89-45dc-8e69-376d8adb9404 {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:02:24.713929 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Updating instance_info_cache with network_info: [{"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:24.754424 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-5dd9586e-72b7-409d-806a-0eef5748f0fb tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] volume_snapshot_create: create_info: {'snapshot_id': '862aae29-94b6-4395-b78c-b37453d2b8e3', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98213) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}} May 27 21:02:24.756988 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-5dd9586e-72b7-409d-806a-0eef5748f0fb tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] snap xml: May 27 21:02:24.756988 np0000001553 nova-compute[98213]: May 27 21:02:24.756988 np0000001553 nova-compute[98213]: May 27 21:02:24.756988 np0000001553 nova-compute[98213]: May 27 21:02:24.756988 np0000001553 nova-compute[98213]: May 27 21:02:24.756988 np0000001553 nova-compute[98213]: May 27 21:02:24.756988 np0000001553 nova-compute[98213]: May 27 21:02:24.756988 np0000001553 nova-compute[98213]: May 27 21:02:24.756988 np0000001553 nova-compute[98213]: May 27 21:02:24.756988 np0000001553 nova-compute[98213]: {{(pid=98213) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}} May 27 21:02:24.757341 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-5dd9586e-72b7-409d-806a-0eef5748f0fb tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] Lazy-loading 'system_metadata' on Instance uuid 69083572-b3e6-403a-ae54-6f128a2c88f9 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:24.805391 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b2bad970-880a-4c1d-b2a8-08fcdb0aee4d tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] volume_snapshot_delete: delete_info: {'volume_id': '961c3d36-44a0-4e83-897a-a18e19c8c262'} {{(pid=98213) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}} May 27 21:02:24.811301 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [None req-b2bad970-880a-4c1d-b2a8-08fcdb0aee4d tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type' May 27 21:02:24.811301 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Traceback (most recent call last): May 27 21:02:24.811301 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete May 27 21:02:24.811301 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] self._volume_snapshot_delete(context, instance, volume_id, May 27 21:02:24.811301 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete May 27 21:02:24.811301 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] if delete_info['type'] != 'qcow2': May 27 21:02:24.811301 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] ~~~~~~~~~~~^^^^^^^^ May 27 21:02:24.811301 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] KeyError: 'type' May 27 21:02:24.811301 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] May 27 21:02:24.816879 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lazy-loading 'flavor' on Instance uuid 95d3c2a3-6ad3-4458-8771-4f95b37ad16c {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [None req-b2bad970-880a-4c1d-b2a8-08fcdb0aee4d tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found. May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver self._volume_snapshot_delete(context, instance, volume_id, May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver if delete_info['type'] != 'qcow2': May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ~~~~~~~~~~~^^^^^^^^ May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver KeyError: 'type' May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-903c455f-ef5b-4620-8b2e-694113c496ba) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) May 27 21:02:24.853174 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.856495 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post May 27 21:02:24.856495 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) May 27 21:02:24.856495 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.856495 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request May 27 21:02:24.856495 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) May 27 21:02:24.856495 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.856495 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request May 27 21:02:24.856495 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) May 27 21:02:24.856495 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found. May 27 21:02:24.856495 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server [None req-b2bad970-880a-4c1d-b2a8-08fcdb0aee4d tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] Exception during message handling: KeyError: 'type' May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__ May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server self.force_reraise() May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server raise self.value May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_delete(context, instance, volume_id, May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__ May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server self.force_reraise() May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server raise self.value May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server self._volume_snapshot_delete(context, instance, volume_id, May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server if delete_info['type'] != 'qcow2': May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ~~~~~~~~~~~^^^^^^^^ May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server KeyError: 'type' May 27 21:02:24.865780 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server May 27 21:02:24.892926 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:24.894314 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:24.967690 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Unrescuing May 27 21:02:24.968164 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:24.968164 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquired lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:24.968218 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:02:25.143571 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:25.150102 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:25.161873 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:25.161873 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:25.161873 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:25.164307 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:25.164307 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:25.164307 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:25.164307 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:25.174563 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:25.178897 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:25.192888 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.192888 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.192888 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.192888 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.192888 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.192888 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.192888 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.192888 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.192888 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:25.193535 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.193535 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.193535 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.193535 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.193535 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.193535 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.193535 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.193535 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.193535 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:25.193846 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.193846 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.193846 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.193846 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.193846 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.193846 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.193846 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.193846 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.193846 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:25.194415 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.194415 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.194415 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.194415 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.194415 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.194415 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.194415 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.194415 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.194415 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:25.216839 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Releasing lock "refresh_cache-a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:25.217574 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Instance network_info: |[{"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:02:25.219361 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Start _get_guest_xml network_info=[{"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:02:25.222212 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:02:25.223368 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-1815635338', uuid='a8b6e8af-99d6-4ab7-82c7-68af9f22c24f'), owner=OwnerMeta(userid='99659c2947e743c899512883f5a85b0e', username='tempest-ServerActionsTestOtherA-113699651-project-member', projectid='b562b6a1ba2b4c3ab101af22f9d04713', projectname='tempest-ServerActionsTestOtherA-113699651'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915745.2229948) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:02:25.224119 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:02:25.224452 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:02:25.225152 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:02:25.225320 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:02:25.226164 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:02:25.226583 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:02:25.226798 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:02:25.226798 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:02:25.226941 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:02:25.227066 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:02:25.227123 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:02:25.227436 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:02:25.227436 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:02:25.227520 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:02:25.227633 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:02:25.227732 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:02:25.235561 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369, portal: 192.168.40.100,3260] May 27 21:02:25.235561 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369, portal: 192.168.40.100,3260] successful. May 27 21:02:25.235561 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:25.238531 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1815635338',display_name='tempest-tempest.common.compute-instance-1815635338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-tempest-common-compute-instance-1815635338',id=13,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhRyl/gHlTk3NR31kz1TMU4ugUtNRNhvt3/is5Ou9Gh8FfxeQaQSkn9eAA9+1tgiBOuvzlKK/vItMkljBAUDewfhHBGnxPq32YISNTcCVOesxqFgmJRR6kSx4SB246g4g==',key_name='tempest-keypair-1121332834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b562b6a1ba2b4c3ab101af22f9d04713',ramdisk_id='',reservation_id='r-mometahb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-113699651',owner_user_name='tempest-ServerActionsTestOtherA-113699651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99659c2947e743c899512883f5a85b0e',uuid=a8b6e8af-99d6-4ab7-82c7-68af9f22c24f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:02:25.238686 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converting VIF {"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:25.239267 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:25.239842 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lazy-loading 'pci_devices' on Instance uuid a8b6e8af-99d6-4ab7-82c7-68af9f22c24f {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:25.241153 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369, portal: 192.168.50.100,3260] May 27 21:02:25.241153 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369, portal: 192.168.50.100,3260] successful. May 27 21:02:25.241153 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:25.249300 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:25.256046 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:25.260156 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-5dd9586e-72b7-409d-806a-0eef5748f0fb tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Skipping quiescing instance: QEMU guest agent is not enabled. May 27 21:02:25.266066 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [None req-5dd9586e-72b7-409d-806a-0eef5748f0fb tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory May 27 21:02:25.266066 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Traceback (most recent call last): May 27 21:02:25.266066 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create May 27 21:02:25.266066 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] guest.snapshot(snapshot, no_metadata=True, disk_only=True, May 27 21:02:25.266066 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot May 27 21:02:25.266066 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] self._domain.snapshotCreateXML(device_xml, flags=flags) May 27 21:02:25.266066 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML May 27 21:02:25.266066 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] raise libvirtError('virDomainSnapshotCreateXML() failed') May 27 21:02:25.266066 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory May 27 21:02:25.266066 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [None req-5dd9586e-72b7-409d-806a-0eef5748f0fb tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Traceback (most recent call last): May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] self._volume_snapshot_create(context, instance, guest, May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] guest.snapshot(snapshot, no_metadata=True, disk_only=True, May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] self._domain.snapshotCreateXML(device_xml, flags=flags) May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] raise libvirtError('virDomainSnapshotCreateXML() failed') May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory May 27 21:02:25.267404 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] May 27 21:02:25.269276 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:25.269276 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.269276 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:25.269935 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:25.270180 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:25.271679 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('11', '-', '-', 0) found on session 13 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:25.271943 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:25.278086 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.278086 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.278086 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.278086 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:25.278086 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:25.278086 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.278086 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.278086 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.278086 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.278086 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.278086 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:25.278359 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.278359 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.278359 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:25.278359 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:25.278359 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:25.278359 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.278359 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:25.278359 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.278359 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:25.278359 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:25.278359 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:25.278641 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:25.278641 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:25.280487 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('12', '-', '-', 0) found on session 14 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:25.280631 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:25.281413 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:02:25.281736 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e75d999-c6d6-489b-8483-5f3a34c5b898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:25.281915 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:25.288673 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 13 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:25.288673 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:25.299442 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 14 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:25.299442 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver [None req-5dd9586e-72b7-409d-806a-0eef5748f0fb tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 862aae29-94b6-4395-b78c-b37453d2b8e3 could not be found. May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver self._volume_snapshot_create(context, instance, guest, May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver guest.snapshot(snapshot, no_metadata=True, disk_only=True, May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver self._domain.snapshotCreateXML(device_xml, flags=flags) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver raise libvirtError('virDomainSnapshotCreateXML() failed') May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 862aae29-94b6-4395-b78c-b37453d2b8e3 could not be found. (HTTP 404) (Request-ID: req-424e6f2f-2d73-43e8-b087-1262511a473e) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( May 27 21:02:25.306689 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 862aae29-94b6-4395-b78c-b37453d2b8e3 could not be found. May 27 21:02:25.307855 np0000001553 nova-compute[98213]: ERROR nova.virt.libvirt.driver May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server [None req-5dd9586e-72b7-409d-806a-0eef5748f0fb tempest-VolumesAssistedSnapshotsTest-242550467 tempest-VolumesAssistedSnapshotsTest-242550467-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__ May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server self.force_reraise() May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server raise self.value May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_create(context, instance, volume_id, May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__ May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server self.force_reraise() May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server raise self.value May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server self._volume_snapshot_create(context, instance, guest, May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server guest.snapshot(snapshot, no_metadata=True, disk_only=True, May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server self._domain.snapshotCreateXML(device_xml, flags=flags) May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server raise libvirtError('virDomainSnapshotCreateXML() failed') May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory May 27 21:02:25.310511 np0000001553 nova-compute[98213]: ERROR oslo_messaging.rpc.server May 27 21:02:25.398830 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] During sync_power_state the instance has a pending task (unrescuing). Skip. May 27 21:02:25.422918 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:25.470213 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:25.493506 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:25.493675 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:25.746171 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] End _get_guest_xml xml= May 27 21:02:25.746171 np0000001553 nova-compute[98213]: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f May 27 21:02:25.746171 np0000001553 nova-compute[98213]: instance-0000000d May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 196608 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 1 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: tempest-tempest.common.compute-instance-1815635338 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 2026-05-27 21:02:25 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 192 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 1 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 0 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 0 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 1 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: True May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: bare May 27 21:02:25.746171 np0000001553 nova-compute[98213]: qcow2 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 1 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 0 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: virtio May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-113699651-project-member May 27 21:02:25.746171 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-113699651 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:02:25.746171 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f May 27 21:02:25.746171 np0000001553 nova-compute[98213]: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f May 27 21:02:25.746171 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: hvm May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 128 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: 1 May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: Nehalem May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: May 27 21:02:25.746171 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:02:25.749405 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Preparing to wait for external event network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:02:25.749405 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:25.749405 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:25.749405 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:25.749405 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1815635338',display_name='tempest-tempest.common.compute-instance-1815635338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-tempest-common-compute-instance-1815635338',id=13,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhRyl/gHlTk3NR31kz1TMU4ugUtNRNhvt3/is5Ou9Gh8FfxeQaQSkn9eAA9+1tgiBOuvzlKK/vItMkljBAUDewfhHBGnxPq32YISNTcCVOesxqFgmJRR6kSx4SB246g4g==',key_name='tempest-keypair-1121332834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b562b6a1ba2b4c3ab101af22f9d04713',ramdisk_id='',reservation_id='r-mometahb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-113699651',owner_user_name='tempest-ServerActionsTestOtherA-113699651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99659c2947e743c899512883f5a85b0e',uuid=a8b6e8af-99d6-4ab7-82c7-68af9f22c24f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:02:25.749822 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converting VIF {"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:25.749822 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:25.749822 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:02:25.749822 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:25.750058 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:25.752998 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:02:25.752998 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:25.752998 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11f43bc6-9e1d-559e-ac28-3b1b84c93747', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:25.752998 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:25.752998 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:25.753496 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:25.759660 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:25.759934 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2dc1bc4-0c, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:25.760423 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2dc1bc4-0c, col_values=(('qos', UUID('808bf6b7-e07f-46ac-b4c8-34c16fe20cee')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:25.760614 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2dc1bc4-0c, col_values=(('external_ids', {'iface-id': 'a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:72:07', 'vm-uuid': 'a8b6e8af-99d6-4ab7-82c7-68af9f22c24f'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:25.761770 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:25.762991 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:25.770559 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:25.772335 np0000001553 nova-compute[98213]: INFO os_vif [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') May 27 21:02:25.806810 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:25.828850 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc02b851-5c19-4499-9cc7-7a6e89c7ee8b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.812s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:25.959468 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Updating instance_info_cache with network_info: [{"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:25.963961 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:25.964127 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:25.964200 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:25.964392 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No VIF found with MAC fa:16:3e:6e:ec:22, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:25.996178 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Detaching volume 961c3d36-44a0-4e83-897a-a18e19c8c262 May 27 21:02:26.044958 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Attempting to driver detach volume 961c3d36-44a0-4e83-897a-a18e19c8c262 from mountpoint /dev/vdb May 27 21:02:26.056211 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Found disk vdb by alias ua-961c3d36-44a0-4e83-897a-a18e19c8c262 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:26.057514 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Found disk vdb by alias ua-961c3d36-44a0-4e83-897a-a18e19c8c262 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:26.057643 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Attempting to detach device vdb from instance 69083572-b3e6-403a-ae54-6f128a2c88f9 from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:02:26.057945 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] detach device xml: May 27 21:02:26.057945 np0000001553 nova-compute[98213]: May 27 21:02:26.057945 np0000001553 nova-compute[98213]: May 27 21:02:26.057945 np0000001553 nova-compute[98213]: May 27 21:02:26.057945 np0000001553 nova-compute[98213]: May 27 21:02:26.057945 np0000001553 nova-compute[98213]: 961c3d36-44a0-4e83-897a-a18e19c8c262 May 27 21:02:26.057945 np0000001553 nova-compute[98213]:
May 27 21:02:26.057945 np0000001553 nova-compute[98213]: May 27 21:02:26.057945 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:26.064982 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Successfully detached device vdb from instance 69083572-b3e6-403a-ae54-6f128a2c88f9 from the persistent domain config. May 27 21:02:26.065237 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] (1/8): Attempting to detach device vdb with device alias ua-961c3d36-44a0-4e83-897a-a18e19c8c262 from instance 69083572-b3e6-403a-ae54-6f128a2c88f9 from the live domain config. {{(pid=98213) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} May 27 21:02:26.065500 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] detach device xml: May 27 21:02:26.065500 np0000001553 nova-compute[98213]: May 27 21:02:26.065500 np0000001553 nova-compute[98213]: May 27 21:02:26.065500 np0000001553 nova-compute[98213]: May 27 21:02:26.065500 np0000001553 nova-compute[98213]: May 27 21:02:26.065500 np0000001553 nova-compute[98213]: 961c3d36-44a0-4e83-897a-a18e19c8c262 May 27 21:02:26.065500 np0000001553 nova-compute[98213]:
May 27 21:02:26.065500 np0000001553 nova-compute[98213]: May 27 21:02:26.065500 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:26.118750 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:02:26.460919 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Releasing lock "refresh_cache-ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:26.461334 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'flavor' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:26.586115 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Received event ua-961c3d36-44a0-4e83-897a-a18e19c8c262> from libvirt while the driver is waiting for it; dispatched. {{(pid=98213) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} May 27 21:02:26.586527 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-961c3d36-44a0-4e83-897a-a18e19c8c262 for instance 69083572-b3e6-403a-ae54-6f128a2c88f9 {{(pid=98213) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} May 27 21:02:26.589126 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Successfully detached device vdb from instance 69083572-b3e6-403a-ae54-6f128a2c88f9 from the live domain config. May 27 21:02:26.589998 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:02:26.590322 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '961c3d36-44a0-4e83-897a-a18e19c8c262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:26.590470 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:26.690349 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:26.742930 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:26.743085 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:26.743378 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:26.743515 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:26.743611 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:26.745627 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Terminating instance May 27 21:02:27.000868 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.004999 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.024673 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.137778 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Found WWN 330000000c0633167 for multipath device dm-4 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:02:27.138513 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:27.138513 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== connect_volume: return (4466ms) {'type': 'block', 'scsi_wwn': '330000000c0633167', 'path': '/dev/dm-4', 'multipath_id': '330000000c0633167'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:27.138513 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c0633167', 'path': '/dev/dm-4', 'multipath_id': '330000000c0633167'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:02:27.139157 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.857s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:27.139320 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e75d999-c6d6-489b-8483-5f3a34c5b898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:02:27.149200 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'flavor' on Instance uuid a6108bdf-d518-447f-927d-43d7fa6456e2 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:27.157510 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:27.158019 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:27.158674 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:27.159315 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:27.162487 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:27.162487 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:27.169969 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:27.169969 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:27.178686 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:27.178686 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:27.184019 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898] added May 27 21:02:27.184019 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:27.184019 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:27.184019 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:27.184019 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:27.184019 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:27.184019 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:27.184216 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:27.185100 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:27.185100 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:27.193631 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898] added May 27 21:02:27.193631 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:27.193631 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:27.193631 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:27.193631 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:27.193631 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:27.193631 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:27.194094 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:27.194094 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:27.195752 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:27.195752 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.205020 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.210506 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8646fc98-def2-4005-97a2-ecebc213ed3f req-44092f44-a6bf-466e-b0d7-91c85c9a5604 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:27.210506 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8646fc98-def2-4005-97a2-ecebc213ed3f req-44092f44-a6bf-466e-b0d7-91c85c9a5604 service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:27.210607 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8646fc98-def2-4005-97a2-ecebc213ed3f req-44092f44-a6bf-466e-b0d7-91c85c9a5604 service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:27.210736 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8646fc98-def2-4005-97a2-ecebc213ed3f req-44092f44-a6bf-466e-b0d7-91c85c9a5604 service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:27.210869 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8646fc98-def2-4005-97a2-ecebc213ed3f req-44092f44-a6bf-466e-b0d7-91c85c9a5604 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:27.210988 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-8646fc98-def2-4005-97a2-ecebc213ed3f req-44092f44-a6bf-466e-b0d7-91c85c9a5604 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received unexpected event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:27.250334 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:02:27.281600 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.282982 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.304752 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:27.304885 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:27.304994 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No VIF found with MAC fa:16:3e:74:72:07, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:27.305553 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Using config drive May 27 21:02:27.317492 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999519330000112 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:27.318298 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.319448 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.997939054000199 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:27.319448 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.997738443000117 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:27.322066 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Instance destroyed successfully. May 27 21:02:27.322500 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'numa_topology' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:27.326392 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.357071 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.360056 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:27.543876 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-46c6efe2-fa5e-4615-a8bf-7ccb646f26a1 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.243s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:27.609342 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999690117 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:27.610767 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Instance destroyed successfully. May 27 21:02:27.612087 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lazy-loading 'resources' on Instance uuid 95d3c2a3-6ad3-4458-8771-4f95b37ad16c {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:27.652938 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Attempting to attach volume d6a1fc42-6b17-46f6-b4f0-a605fb6da369 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:02:27.655408 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] attach device xml: May 27 21:02:27.655408 np0000001553 nova-compute[98213]: May 27 21:02:27.655408 np0000001553 nova-compute[98213]: May 27 21:02:27.655408 np0000001553 nova-compute[98213]: May 27 21:02:27.655408 np0000001553 nova-compute[98213]: May 27 21:02:27.655408 np0000001553 nova-compute[98213]: d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:27.655408 np0000001553 nova-compute[98213]: May 27 21:02:27.655408 np0000001553 nova-compute[98213]: May 27 21:02:27.655408 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:02:27.813511 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:27.827952 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:27.942415 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Creating config drive at /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.config May 27 21:02:27.945912 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc9i9kgbz {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:27.981650 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc9i9kgbz" returned: 0 in 0.035s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:28.118225 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-784414459',display_name='tempest-AttachSCSIVolumeTestJSON-server-784414459',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-attachscsivolumetestjson-server-784414459',id=5,image_ref='5e190bcd-e265-4587-9b9c-19c206da345e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe1GalP+gY/jzcdebDoXADuRBq4cg069T8lFla8oIGt7yhYXPMkeNrN6zb0OLYUOMOFMn6P9RTZ3qJxTZPf4T9/DidK0caJhxHWhPGxpI3gxFTfgAc08JdIz8LVKMO3Eg==',key_name='tempest-keypair-1085935183',keypairs=,launch_index=0,launched_at=2026-05-27T21:01:28Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='018d84b86f0542529549fee42f6b2815',ramdisk_id='',reservation_id='r-e9u8tr5h',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5e190bcd-e265-4587-9b9c-19c206da345e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-802568575',owner_user_name='tempest-AttachSCSIVolumeTestJSON-802568575-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5781e414d7324bfcab1b49b294174048',uuid=95d3c2a3-6ad3-4458-8771-4f95b37ad16c,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:02:28.118843 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Converting VIF {"id": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "address": "fa:16:3e:82:28:ab", "network": {"id": "4253b50e-7358-4db7-be07-3aabc5ffa250", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1191309945-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "018d84b86f0542529549fee42f6b2815", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9da3ce-b0", "ovs_interfaceid": "da9da3ce-b0fd-4658-8440-3096b21ff91d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:28.119030 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:28:ab,bridge_name='br-int',has_traffic_filtering=True,id=da9da3ce-b0fd-4658-8440-3096b21ff91d,network=Network(4253b50e-7358-4db7-be07-3aabc5ffa250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9da3ce-b0') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:28.119296 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:28:ab,bridge_name='br-int',has_traffic_filtering=True,id=da9da3ce-b0fd-4658-8440-3096b21ff91d,network=Network(4253b50e-7358-4db7-be07-3aabc5ffa250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9da3ce-b0') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:02:28.120975 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.121265 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda9da3ce-b0, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:28.125648 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:28.134542 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.138107 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Rescuing May 27 21:02:28.139558 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.139949 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:28.140099 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6df110e-ac47-4418-bf5a-9ba48b7b76b9) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:28.144177 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquired lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:28.144177 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:28.144177 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:02:28.153435 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.156609 np0000001553 nova-compute[98213]: INFO os_vif [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:28:ab,bridge_name='br-int',has_traffic_filtering=True,id=da9da3ce-b0fd-4658-8440-3096b21ff91d,network=Network(4253b50e-7358-4db7-be07-3aabc5ffa250),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9da3ce-b0') May 27 21:02:28.157019 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Deleting instance files /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c_del May 27 21:02:28.157747 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Deletion of /opt/stack/data/nova/instances/95d3c2a3-6ad3-4458-8771-4f95b37ad16c_del complete May 27 21:02:28.185488 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:28.197480 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:28.211280 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:28.211280 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:28.211280 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:28.213508 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:28.213508 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:28.213508 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:28.213508 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:28.224163 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:28.227834 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:28.241418 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.241418 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.241418 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.241418 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.241418 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.241418 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.241418 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.241418 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.241418 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.241418 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.241418 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:28.241669 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.241669 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.241669 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.241669 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.241669 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.241669 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.241669 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.241669 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.241669 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.241669 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.241669 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:28.247204 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.247204 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.247204 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.247204 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.247204 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.247204 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.247204 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.247204 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.247204 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.247204 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.247204 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:28.247467 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.247467 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.247467 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.247467 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.247467 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.247467 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.247467 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.247467 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.247467 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.247467 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.247467 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:28.295929 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898, portal: 192.168.40.100,3260] May 27 21:02:28.295929 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898, portal: 192.168.40.100,3260] successful. May 27 21:02:28.295929 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:28.305883 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898, portal: 192.168.50.100,3260] May 27 21:02:28.305883 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898, portal: 192.168.50.100,3260] successful. May 27 21:02:28.305883 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:28.311914 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:28.318903 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:28.330772 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.330772 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:28.331208 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.331208 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:28.331457 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:28.331457 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:28.332647 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] HCTL ('17', '-', '-', 0) found on session 15 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:28.332765 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:28.341848 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.341848 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:28.342136 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:28.342136 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:28.342386 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:28.342547 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:28.346718 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] HCTL ('18', '-', '-', 0) found on session 16 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:28.346718 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:28.350621 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Searching for a device in session 15 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:28.350861 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e75d999-c6d6-489b-8483-5f3a34c5b898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:28.366974 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Searching for a device in session 16 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:28.367156 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5e75d999-c6d6-489b-8483-5f3a34c5b898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:28.608820 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.639565 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.650000 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:28.669658 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Took 1.42 seconds to destroy the instance on the hypervisor. May 27 21:02:28.670450 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:02:28.671342 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:02:28.671513 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:02:28.671887 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:28.720363 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.745486 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.747881 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.772581 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:28.825978 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.828949 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.849183 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.964491 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:28.979206 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-eaa3d8b1-6f44-478b-aea9-b57d6f99a625 req-b8d8bb86-7c86-45a2-9e5a-9edd21f8c6ce service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:28.979845 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-eaa3d8b1-6f44-478b-aea9-b57d6f99a625 req-b8d8bb86-7c86-45a2-9e5a-9edd21f8c6ce service nova] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:28.979981 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-eaa3d8b1-6f44-478b-aea9-b57d6f99a625 req-b8d8bb86-7c86-45a2-9e5a-9edd21f8c6ce service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:28.980176 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-eaa3d8b1-6f44-478b-aea9-b57d6f99a625 req-b8d8bb86-7c86-45a2-9e5a-9edd21f8c6ce service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:28.980386 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-eaa3d8b1-6f44-478b-aea9-b57d6f99a625 req-b8d8bb86-7c86-45a2-9e5a-9edd21f8c6ce service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Processing event network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:02:29.034440 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:29.160416 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:02:29.226395 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:29.310035 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:29.310414 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:29.310590 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:29.310731 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:29.310876 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:29.311021 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received unexpected event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:29.311172 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received event network-vif-unplugged-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:29.311312 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:29.311446 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:29.311562 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:29.311707 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] No waiting events found dispatching network-vif-unplugged-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:29.311848 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received event network-vif-unplugged-da9da3ce-b0fd-4658-8440-3096b21ff91d for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:02:29.311969 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received event network-vif-unplugged-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:29.312100 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Acquiring lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:29.314277 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:29.314354 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:29.314511 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] No waiting events found dispatching network-vif-unplugged-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:29.315691 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received event network-vif-unplugged-da9da3ce-b0fd-4658-8440-3096b21ff91d for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:02:29.315969 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:29.316110 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:29.317474 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:29.317877 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:29.318486 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:29.318732 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:29.319552 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received unexpected event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:29.319552 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:29.319552 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:29.319747 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:29.319937 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:29.320253 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:29.320530 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:29.320677 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No VIF found with MAC fa:16:3e:12:51:b6, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:29.323636 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:29.323636 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-c9db9b2e-e2c9-445a-b217-ff4af5c8a602 req-b86c01d2-b211-45d6-bb2f-7735c565319a service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received unexpected event network-vif-plugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:29.405903 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updating instance_info_cache with network_info: [{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:29.561269 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d5500b64-37f1-4ee3-97c1-93dcd43554ab req-51361326-435e-4903-ab2c-91d76e1b32fe service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Received event network-vif-deleted-da9da3ce-b0fd-4658-8440-3096b21ff91d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:29.561483 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-d5500b64-37f1-4ee3-97c1-93dcd43554ab req-51361326-435e-4903-ab2c-91d76e1b32fe service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Neutron deleted interface da9da3ce-b0fd-4658-8440-3096b21ff91d; detaching it from the instance and deleting it from the info cache May 27 21:02:29.564638 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d5500b64-37f1-4ee3-97c1-93dcd43554ab req-51361326-435e-4903-ab2c-91d76e1b32fe service nova] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Detach interface failed, port_id=da9da3ce-b0fd-4658-8440-3096b21ff91d, reason: Instance 95d3c2a3-6ad3-4458-8771-4f95b37ad16c could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:02:29.757712 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:02:29.758776 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-ef1d56fa-533a-4a76-b359-832131d0f3c7 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:29.759491 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:02:29.759638 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:29.759780 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] VM Resumed (Lifecycle Event) May 27 21:02:29.761416 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:02:29.765341 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Instance spawned successfully. May 27 21:02:29.765781 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:02:29.908952 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Releasing lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:29.985513 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:30.180750 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Found WWN 330000000da4990e6 for multipath device dm-7 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:02:30.182572 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:30.182572 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] <== connect_volume: return (4900ms) {'type': 'block', 'scsi_wwn': '330000000da4990e6', 'path': '/dev/dm-7', 'multipath_id': '330000000da4990e6'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:30.182572 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000da4990e6', 'path': '/dev/dm-7', 'multipath_id': '330000000da4990e6'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:02:30.182572 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.592s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:30.183619 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '961c3d36-44a0-4e83-897a-a18e19c8c262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:02:30.183619 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:02:30.188893 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lazy-loading 'flavor' on Instance uuid aac9c5e0-da16-44ef-b255-53b21d0cc63d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:30.212347 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:30.212347 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:30.212602 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262 (non-flash) May 27 21:02:30.212602 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:30.212602 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', '9')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:02:30.212899 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', '9')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:02:30.213937 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262', '10')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:02:30.215319 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Resulting device map defaultdict(. at 0x79ced2731ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262'): ({'sdi'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:02:30.215319 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Removing multipathed devices sdh, sdi {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:02:30.215901 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Flush multipath device 330000000adddd7d6 {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:02:30.251638 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:02:30.263165 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:30.273976 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:30.286536 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:30.286675 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:30.287030 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:30.287299 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:30.287603 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:30.287943 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:30.313277 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:02:30.322391 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:30.322391 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:30.370673 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:02:30.370860 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] SCSI volumes sdh, sdi have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:02:30.372477 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:02:30.384223 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:02:30.384447 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:02:30.396545 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:30.434358 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262, portal: 192.168.40.100,3260] May 27 21:02:30.434358 np0000001553 nova-compute[98213]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262, portal: 192.168.40.100,3260] successful. May 27 21:02:30.434358 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:30.453065 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:30.463827 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:30.487464 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Took 1.82 seconds to deallocate network for instance. May 27 21:02:30.494094 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262, portal: 192.168.50.100,3260] May 27 21:02:30.494094 np0000001553 nova-compute[98213]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-961c3d36-44a0-4e83-897a-a18e19c8c262, portal: 192.168.50.100,3260] successful. May 27 21:02:30.494094 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:30.517336 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:30.517651 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:30.517797 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] <== disconnect_volume: return (3927ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:30.517911 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:02:30.691499 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Attempting to attach volume 5e75d999-c6d6-489b-8483-5f3a34c5b898 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:02:30.692608 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] attach device xml: May 27 21:02:30.692608 np0000001553 nova-compute[98213]: May 27 21:02:30.692608 np0000001553 nova-compute[98213]: May 27 21:02:30.692608 np0000001553 nova-compute[98213]: May 27 21:02:30.692608 np0000001553 nova-compute[98213]: May 27 21:02:30.692608 np0000001553 nova-compute[98213]: 5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:30.692608 np0000001553 nova-compute[98213]: May 27 21:02:30.692608 np0000001553 nova-compute[98213]: May 27 21:02:30.692608 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:02:30.783717 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:30.783940 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] VM Started (Lifecycle Event) May 27 21:02:30.800584 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Took 7.63 seconds to spawn the instance on the hypervisor. May 27 21:02:30.802618 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:30.825282 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lazy-loading 'flavor' on Instance uuid 950bfe97-53fd-4086-bfa5-69ea3a75c088 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:30.885742 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-feeeedd1-dc27-436e-b20a-483722e6593f tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.973s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:30.993293 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:30.993546 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:31.037020 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-3a92ec01-49f5-4fb2-97c5-6f709cb06288 req-cf9e9cb1-9e9c-4c92-91ff-678d90d730f8 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:31.037199 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3a92ec01-49f5-4fb2-97c5-6f709cb06288 req-cf9e9cb1-9e9c-4c92-91ff-678d90d730f8 service nova] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:31.037347 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3a92ec01-49f5-4fb2-97c5-6f709cb06288 req-cf9e9cb1-9e9c-4c92-91ff-678d90d730f8 service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:31.037458 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3a92ec01-49f5-4fb2-97c5-6f709cb06288 req-cf9e9cb1-9e9c-4c92-91ff-678d90d730f8 service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:31.037577 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-3a92ec01-49f5-4fb2-97c5-6f709cb06288 req-cf9e9cb1-9e9c-4c92-91ff-678d90d730f8 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] No waiting events found dispatching network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:31.037728 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-3a92ec01-49f5-4fb2-97c5-6f709cb06288 req-cf9e9cb1-9e9c-4c92-91ff-678d90d730f8 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received unexpected event network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb for instance with vm_state active and task_state None. May 27 21:02:31.074366 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lazy-loading 'flavor' on Instance uuid 69083572-b3e6-403a-ae54-6f128a2c88f9 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:31.288769 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:31.291841 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:31.310237 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Took 13.43 seconds to build instance. May 27 21:02:31.528461 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:31.531755 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:31.558950 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:31.562809 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:31.571343 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:31.572096 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:31.589806 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:31.692398 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:31.758291 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:02:31.758481 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:02:31.796081 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:31.796259 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] VM Started (Lifecycle Event) May 27 21:02:31.811534 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.942s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:31.829878 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.508s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:31.847395 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Instance destroyed successfully. May 27 21:02:31.848156 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'numa_topology' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:32.075848 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'flavor' on Instance uuid 698b750b-959f-4358-b7a0-5f68e76f5a4a {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:32.087165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a36eac2a-ddc4-4a6e-bebd-7bcf84cc2c6a tempest-VolumesAssistedSnapshotsTest-1741670566 tempest-VolumesAssistedSnapshotsTest-1741670566-project-admin] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.593s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:32.261347 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:02:32.279914 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8e5f2d77-deb9-44e3-a441-b475a46e50b5 req-3043bb46-485a-4a69-ab95-cd132a262598 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:32.280084 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8e5f2d77-deb9-44e3-a441-b475a46e50b5 req-3043bb46-485a-4a69-ab95-cd132a262598 service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:32.280255 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8e5f2d77-deb9-44e3-a441-b475a46e50b5 req-3043bb46-485a-4a69-ab95-cd132a262598 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:32.280386 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8e5f2d77-deb9-44e3-a441-b475a46e50b5 req-3043bb46-485a-4a69-ab95-cd132a262598 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:32.280508 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8e5f2d77-deb9-44e3-a441-b475a46e50b5 req-3043bb46-485a-4a69-ab95-cd132a262598 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] No waiting events found dispatching network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:32.280648 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-8e5f2d77-deb9-44e3-a441-b475a46e50b5 req-3043bb46-485a-4a69-ab95-cd132a262598 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received unexpected event network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 for instance with vm_state active and task_state rescuing. May 27 21:02:32.299861 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:32.309866 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:32.312965 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "d61bda11-c563-480f-9f5f-7d85ef081cae" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:32.313279 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:32.357412 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Attempting a stable device rescue May 27 21:02:32.380479 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:32.380837 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:32.380837 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:32.380837 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No VIF found with MAC fa:16:3e:f9:23:9e, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:32.483433 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98213) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} May 27 21:02:32.489766 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Instance directory exists: not creating {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} May 27 21:02:32.489928 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Creating image(s) May 27 21:02:32.490749 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "/opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:32.490939 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "/opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:32.491911 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "/opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:32.492131 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'trusted_certs' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:32.768676 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.775s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:32.818707 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:32.818912 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] VM Paused (Lifecycle Event) May 27 21:02:32.821595 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:02:32.867641 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Deleted allocations for instance 95d3c2a3-6ad3-4458-8771-4f95b37ad16c May 27 21:02:32.936858 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:32.937031 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:32.937260 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Attaching volume 23f1203c-2f1d-487c-8874-bb9efa65e764 to /dev/vdb May 27 21:02:32.985504 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:32.994432 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Object Instance<22e422c7-47a4-4619-92a8-b05b73989943> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:32.994432 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "f1fa4885195ef2fda29eab0c5e4112713d6cbab5" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:32.995338 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "f1fa4885195ef2fda29eab0c5e4112713d6cbab5" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:32.997087 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:02:33.017212 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:33.045752 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:02:33.046345 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:02:33.057224 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:02:33.057224 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe5e:af46', 'fe80::60c7:cff:fed6:aac2', 'fe80::fc16:3eff:fef9:239e', 'fe80::f4a8:7bff:feae:7ec3', 'fe80::fc16:3eff:fe2b:af36', 'fe80::fc16:3eff:fe83:3ad3', 'fe80::f44b:ecff:feb6:e23', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc', 'fe80::fc16:3eff:fe74:7207'] May 27 21:02:33.057224 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:02:33.057224 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:02:33.057224 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] <== get_connector_properties: return (71ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:33.057224 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating existing volume attachment record: 414c9b08-d7e7-4fb6-99c2-de3ed2f61b3b {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:02:33.086211 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:33.149289 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:33.335097 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:33.339553 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:33.339779 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] VM Resumed (Lifecycle Event) May 27 21:02:33.388007 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:33.393063 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:33.399299 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:02:33.399444 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Claim successful on node np0000001553 May 27 21:02:33.537956 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:02:33.538409 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:02:33.538741 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:02:33.539293 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:02:33.539675 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:02:33.540296 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:02:33.540455 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:02:33.543307 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:02:33.543431 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98213) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} May 27 21:02:33.543692 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager.update_available_resource {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:02:33.627044 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:02:33.627960 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:33.628099 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:33.629305 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:33.629490 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:02:33.643992 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:33.644612 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:33.644880 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:33.646693 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:33.647238 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:33.647456 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:33.661571 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:33.661571 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:33.662449 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:02:33.662449 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:33.676417 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764] added May 27 21:02:33.676417 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:33.676417 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:33.676417 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:33.676417 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:33.676417 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:33.676417 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:33.676756 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:33.676793 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:33.677012 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:33.677840 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764] added May 27 21:02:33.677840 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:02:33.677840 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:33.677840 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:33.677840 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:02:33.677840 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:02:33.677840 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:33.678041 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:02:33.678247 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:02:33.678439 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:02:33.843675 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:33.845242 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:33.874334 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d32f9303-0e19-4cec-9ad9-e0e7efe59c9b tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Lock "95d3c2a3-6ad3-4458-8771-4f95b37ad16c" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.131s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:33.948258 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bdfa997d-e51a-4ad7-a79d-d7f25eefa84d tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.379s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:34.048918 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:34.054325 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:34.054740 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:34.112201 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:34.114606 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:34.114916 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5.part --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:34.193950 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:34.194313 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:34.194544 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Attaching volume d6a1fc42-6b17-46f6-b4f0-a605fb6da369 to /dev/vdb May 27 21:02:34.205155 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5.part --force-share --output=json" returned: 0 in 0.090s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:34.205544 np0000001553 nova-compute[98213]: DEBUG nova.virt.images [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] cfd721df-bd9d-498a-9aaf-77d8b1aab617 was qcow2, converting to raw {{(pid=98213) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} May 27 21:02:34.207418 np0000001553 nova-compute[98213]: DEBUG nova.privsep.utils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98213) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} May 27 21:02:34.207418 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5.part /opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5.converted {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:34.253950 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:34.267310 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:02:34.286284 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:34.316605 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:02:34.317020 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:02:34.328010 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:02:34.330336 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe5e:af46', 'fe80::60c7:cff:fed6:aac2', 'fe80::fc16:3eff:fef9:239e', 'fe80::f4a8:7bff:feae:7ec3', 'fe80::fc16:3eff:fe2b:af36', 'fe80::fc16:3eff:fe83:3ad3', 'fe80::f44b:ecff:feb6:e23', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc', 'fe80::fc16:3eff:fe74:7207'] May 27 21:02:34.330442 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:02:34.330750 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:02:34.331699 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:34.331699 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Updating existing volume attachment record: 7722a54c-f19f-406d-9566-026fc6ccd1c5 {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:02:34.348447 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999675659000104 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:34.361264 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:34.362362 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5.part /opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5.converted" returned: 0 in 0.154s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:34.362362 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:34.362485 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:34.362688 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:34.362904 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] No waiting events found dispatching network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:34.363100 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received unexpected event network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 for instance with vm_state active and task_state rescuing. May 27 21:02:34.363276 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-changed-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:34.363412 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Refreshing instance network info cache due to event network-changed-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:34.363691 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] Acquiring lock "refresh_cache-a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:34.363907 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] Acquired lock "refresh_cache-a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:34.363907 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Refreshing network info cache for port a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:34.373097 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5.converted --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:34.455719 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5.converted --force-share --output=json" returned: 0 in 0.082s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:34.456295 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "f1fa4885195ef2fda29eab0c5e4112713d6cbab5" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.461s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:34.457199 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:34.460099 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:34.461448 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "f1fa4885195ef2fda29eab0c5e4112713d6cbab5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:34.461876 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "f1fa4885195ef2fda29eab0c5e4112713d6cbab5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:34.462184 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:34.464987 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:34.465345 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5 --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:34.515675 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:34.515978 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:34.516288 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:34.516471 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:34.516652 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:34.523602 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Terminating instance May 27 21:02:34.538480 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5 --force-share --output=json" returned: 0 in 0.073s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:34.538863 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5,backing_fmt=raw /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.rescue {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:34.562906 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lazy-loading 'flavor' on Instance uuid d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:34.581646 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1fa4885195ef2fda29eab0c5e4112713d6cbab5,backing_fmt=raw /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.rescue" returned: 0 in 0.042s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:34.582009 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "f1fa4885195ef2fda29eab0c5e4112713d6cbab5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.120s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:34.582304 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'migration_context' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:34.677763 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:34.678805 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:34.696532 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:34.696532 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:34.696532 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:34.701124 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:34.701124 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:34.701124 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:34.701124 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:34.706757 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:34.721475 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:34.727693 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.727693 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.727693 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.727693 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.727693 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.727693 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.727693 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.727693 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.727693 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.727693 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.727693 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:34.728153 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.728153 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.728153 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.728153 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.728153 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.728153 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.728153 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.728153 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.728153 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.728153 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.728153 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:34.740491 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:34.740491 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.740491 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:34.787904 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] May 27 21:02:34.787904 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] successful. May 27 21:02:34.787904 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:34.800015 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] May 27 21:02:34.800015 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] successful. May 27 21:02:34.800015 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:34.805331 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:34.816556 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:34.825701 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.825701 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:34.826008 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.826008 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:34.826229 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:34.826283 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:34.827402 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] HCTL ('13', '-', '-', 0) found on session 17 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:34.827512 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:34.844857 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:34.844857 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:34.844857 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:34.844857 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:34.844857 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:34.845520 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching for a device in session 17 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:34.851275 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:34.851275 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] HCTL ('14', '-', '-', 0) found on session 18 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:34.851275 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:34.864376 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching for a device in session 18 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:34.864376 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:34.866987 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:34.893156 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:02:34.893572 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:34.893845 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:35.027735 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:02:35.058879 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:35.089162 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Object Instance<22e422c7-47a4-4619-92a8-b05b73989943> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:35.089162 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:02:35.089162 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Start _get_guest_xml network_info=[{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "vif_mac": "fa:16:3e:6e:ec:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue={'image_id': 'cfd721df-bd9d-498a-9aaf-77d8b1aab617', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, 'status': 'reserved', 'instance': '22e422c7-47a4-4619-92a8-b05b73989943', 'attached_at': '', 'detached_at': '', 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'serial': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'e467441e-b815-4287-99fb-b5f4658b286d', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:02:35.089162 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'resources' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:35.095394 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:35.125399 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:35.130233 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:35.249611 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-21b81d43-392a-4146-88fb-43e7c162a565 req-ac94a933-9865-4e31-8327-446654e350b4 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received event network-vif-unplugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:35.249802 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-21b81d43-392a-4146-88fb-43e7c162a565 req-ac94a933-9865-4e31-8327-446654e350b4 service nova] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:35.249960 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-21b81d43-392a-4146-88fb-43e7c162a565 req-ac94a933-9865-4e31-8327-446654e350b4 service nova] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:35.250062 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-21b81d43-392a-4146-88fb-43e7c162a565 req-ac94a933-9865-4e31-8327-446654e350b4 service nova] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:35.250190 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-21b81d43-392a-4146-88fb-43e7c162a565 req-ac94a933-9865-4e31-8327-446654e350b4 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] No waiting events found dispatching network-vif-unplugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:35.250315 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-21b81d43-392a-4146-88fb-43e7c162a565 req-ac94a933-9865-4e31-8327-446654e350b4 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received event network-vif-unplugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:02:35.262178 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:02:35.262178 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:02:35.340406 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:35.385809 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999724571000115 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:35.387552 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Instance destroyed successfully. May 27 21:02:35.387797 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lazy-loading 'resources' on Instance uuid 69083572-b3e6-403a-ae54-6f128a2c88f9 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:35.485438 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Updated VIF entry in instance network info cache for port a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:02:35.485800 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Updating instance_info_cache with network_info: [{"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:35.574562 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.520s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:35.598220 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Object Instance<22e422c7-47a4-4619-92a8-b05b73989943> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:35.600094 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:02:35.601275 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-825501870', uuid='22e422c7-47a4-4619-92a8-b05b73989943'), owner=OwnerMeta(userid='e6e7f263d257406d8c7b8ab607d0e609', username='tempest-ServerStableDeviceRescueTest-382424917-project-member', projectid='92da496690954c8fb9c6eb722b956485', projectname='tempest-ServerStableDeviceRescueTest-382424917'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "vif_mac": "fa:16:3e:6e:ec:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915755.600918) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:02:35.602000 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:02:35.602363 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:02:35.602958 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:02:35.603155 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:02:35.603952 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:02:35.604258 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:02:35.604414 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:02:35.604522 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:02:35.604689 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:02:35.604802 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:02:35.604940 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:02:35.605125 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:02:35.605260 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:02:35.605400 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:02:35.605528 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:02:35.605687 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:02:35.605837 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'vcpu_model' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:35.647897 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:02:35.764460 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:02:35.890393 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-814714645',display_name='tempest-VolumesAssistedSnapshotsTest-server-814714645',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-volumesassistedsnapshotstest-server-814714645',id=6,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4oJ0wFajYaTv/TdCwM/olvXNZFN8olbra3nVscAxsoNbva+GHlzmliQmUro9RnfdDLslzk6Nl6z/oQnjXzSVHiJ0NJkhxbnrGSLCHHVFuRxPEw4492/zc+xxn+IdhG9A==',key_name='tempest-keypair-1979148841',keypairs=,launch_index=0,launched_at=2026-05-27T21:01:33Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='071b2253516a48a496af623e0264802a',ramdisk_id='',reservation_id='r-v0lna0t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-30557332',owner_user_name='tempest-VolumesAssistedSnapshotsTest-30557332-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:01:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ed1db4cbd845c58073d5095c37c4e4',uuid=69083572-b3e6-403a-ae54-6f128a2c88f9,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:02:35.890650 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Converting VIF {"id": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "address": "fa:16:3e:5e:af:46", "network": {"id": "4db21723-c86f-4669-b10b-8c12757384f7", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-991409903-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "071b2253516a48a496af623e0264802a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7f24ac-e2", "ovs_interfaceid": "ac7f24ac-e29a-4ba6-b014-76d87fea9c22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:35.891470 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:af:46,bridge_name='br-int',has_traffic_filtering=True,id=ac7f24ac-e29a-4ba6-b014-76d87fea9c22,network=Network(4db21723-c86f-4669-b10b-8c12757384f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f24ac-e2') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:35.891791 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:af:46,bridge_name='br-int',has_traffic_filtering=True,id=ac7f24ac-e29a-4ba6-b014-76d87fea9c22,network=Network(4db21723-c86f-4669-b10b-8c12757384f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f24ac-e2') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:02:35.899898 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:35.900137 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac7f24ac-e2, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:35.901374 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:35.902757 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:35.907049 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:35.908000 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:35.908188 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b5f78a4-8888-426e-85a9-f2eb264ba426) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:35.909240 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:35.909844 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:35.914826 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:35.917084 np0000001553 nova-compute[98213]: INFO os_vif [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:af:46,bridge_name='br-int',has_traffic_filtering=True,id=ac7f24ac-e29a-4ba6-b014-76d87fea9c22,network=Network(4db21723-c86f-4669-b10b-8c12757384f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7f24ac-e2') May 27 21:02:35.917403 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Deleting instance files /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9_del May 27 21:02:35.918134 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Deletion of /opt/stack/data/nova/instances/69083572-b3e6-403a-ae54-6f128a2c88f9_del complete May 27 21:02:35.989752 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4ab32f8d-0cbd-442c-9802-bf34f899274c req-1a569cfc-10f2-4a1c-a984-88c07f3fc628 service nova] Releasing lock "refresh_cache-a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:36.107768 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Object Instance<22e422c7-47a4-4619-92a8-b05b73989943> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:36.118125 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.config --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:36.193784 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.config --force-share --output=json" returned: 0 in 0.075s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:36.194211 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "/opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:36.194453 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "/opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:36.194989 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "/opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:36.195373 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:02:36.195699 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:36.195832 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:36.271753 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.879s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:36.272285 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:02:36.275345 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.226s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:36.276579 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:36.276579 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Auditing locally available compute resources for np0000001553 (node: np0000001553) {{(pid=98213) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} May 27 21:02:36.425529 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Took 1.40 seconds to destroy the instance on the hypervisor. May 27 21:02:36.426213 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:02:36.426406 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:02:36.426536 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:02:36.426887 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:36.516880 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:36.637173 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:36.637355 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:36.637536 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Attaching volume 5e75d999-c6d6-489b-8483-5f3a34c5b898 to /dev/vdb May 27 21:02:36.666621 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Found WWN 330000000c5130650 for multipath device dm-5 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:02:36.666621 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:36.667234 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000c5130650', 'path': '/dev/dm-5', 'multipath_id': '330000000c5130650'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:36.667638 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.773s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:36.668235 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c5130650', 'path': '/dev/dm-5', 'multipath_id': '330000000c5130650'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:02:36.668296 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:02:36.670795 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lazy-loading 'flavor' on Instance uuid 950bfe97-53fd-4086-bfa5-69ea3a75c088 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:36.679812 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:36.680362 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:36.680977 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:36.681207 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:36.681488 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:36.681663 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:36.690497 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:36.701472 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:36.704659 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:36.704659 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:36.704659 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:36.704659 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:36.710004 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:36.710004 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:36.710004 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:36.710004 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:36.714575 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:02:36.724200 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:36.730250 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:36.742496 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:36.742496 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:36.742927 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:36.742927 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:36.742927 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:36.743232 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:36.743660 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('12', '0', '0', 0) found on session 14 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:36.743813 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:36.745306 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:36.760082 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 14 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:36.760409 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:36.762797 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:36.762797 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:36.763299 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:36.763299 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:36.763619 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.082s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:36.763788 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:36.764566 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('11', '0', '0', 0) found on session 13 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:36.764709 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:36.782679 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:02:36.782966 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:02:36.783516 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:36.783978 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:36.791573 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 13 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:36.791812 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:36.792378 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:02:36.792719 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:02:36.801841 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:02:36.805980 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fef9:239e', 'fe80::f4a8:7bff:feae:7ec3', 'fe80::fc16:3eff:fe2b:af36', 'fe80::fc16:3eff:fe83:3ad3', 'fe80::f44b:ecff:feb6:e23', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc', 'fe80::fc16:3eff:fe74:7207'] May 27 21:02:36.813731 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:02:36.813854 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:02:36.814104 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:36.814325 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Updating existing volume attachment record: d31bcba4-7b10-4b94-9678-6c53256ebdd4 {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:02:36.904513 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18e30c231082464ab556592986d8b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fe4bede0c741bfb93a23985eeef42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:02:37.162155 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b9f8079a-df14-4ee3-8a64-b9080c4d36f1 req-49e970f5-9a65-4fde-8528-f224d25f1a96 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received event network-vif-deleted-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:37.162400 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-b9f8079a-df14-4ee3-8a64-b9080c4d36f1 req-49e970f5-9a65-4fde-8528-f224d25f1a96 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Neutron deleted interface ac7f24ac-e29a-4ba6-b014-76d87fea9c22; detaching it from the instance and deleting it from the info cache May 27 21:02:37.165381 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b9f8079a-df14-4ee3-8a64-b9080c4d36f1 req-49e970f5-9a65-4fde-8528-f224d25f1a96 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Detach interface failed, port_id=ac7f24ac-e29a-4ba6-b014-76d87fea9c22, reason: Instance 69083572-b3e6-403a-ae54-6f128a2c88f9 could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:02:37.174424 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Attempting to attach volume 23f1203c-2f1d-487c-8874-bb9efa65e764 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:02:37.175750 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] attach device xml: May 27 21:02:37.175750 np0000001553 nova-compute[98213]: May 27 21:02:37.175750 np0000001553 nova-compute[98213]: May 27 21:02:37.175750 np0000001553 nova-compute[98213]: May 27 21:02:37.175750 np0000001553 nova-compute[98213]: May 27 21:02:37.175750 np0000001553 nova-compute[98213]: 23f1203c-2f1d-487c-8874-bb9efa65e764 May 27 21:02:37.175750 np0000001553 nova-compute[98213]: May 27 21:02:37.175750 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:02:37.291589 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:02:37.323641 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:37.355412 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8c4884a7-2fd9-478c-bda2-6c9bc741d05b req-fb68b037-683c-4df8-b6d5-030577c1ce39 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received event network-vif-unplugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:37.355836 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8c4884a7-2fd9-478c-bda2-6c9bc741d05b req-fb68b037-683c-4df8-b6d5-030577c1ce39 service nova] Acquiring lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:37.356132 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8c4884a7-2fd9-478c-bda2-6c9bc741d05b req-fb68b037-683c-4df8-b6d5-030577c1ce39 service nova] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:37.356814 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8c4884a7-2fd9-478c-bda2-6c9bc741d05b req-fb68b037-683c-4df8-b6d5-030577c1ce39 service nova] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:37.358618 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8c4884a7-2fd9-478c-bda2-6c9bc741d05b req-fb68b037-683c-4df8-b6d5-030577c1ce39 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] No waiting events found dispatching network-vif-unplugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:37.360784 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8c4884a7-2fd9-478c-bda2-6c9bc741d05b req-fb68b037-683c-4df8-b6d5-030577c1ce39 service nova] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Received event network-vif-unplugged-ac7f24ac-e29a-4ba6-b014-76d87fea9c22 for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:02:37.386242 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:02:37.387366 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e75d999-c6d6-489b-8483-5f3a34c5b898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:37.387524 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:37.390877 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Successfully created port: 9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:02:37.411128 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:37.411560 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:37.514234 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:37.517602 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:02:37.520836 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:37.605463 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:37.606331 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:37.608841 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:37.682196 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:02:37.693530 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:37.693952 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:02:37.696351 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:37.776187 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:37.776600 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:37.798209 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:02:37.879197 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:37.882444 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:02:37.885088 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:37.958506 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:37.959834 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.008315 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Successfully updated port: 9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:02:38.036907 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.037311 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:02:38.039780 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.119581 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.120259 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.121495 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Took 1.69 seconds to deallocate network for instance. May 27 21:02:38.202215 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:38.215578 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.217687 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Error from libvirt while getting description of instance-00000006: [Error Code 42] Domain not found: no domain with matching uuid '69083572-b3e6-403a-ae54-6f128a2c88f9' (instance-00000006): libvirt.libvirtError: Domain not found: no domain with matching uuid '69083572-b3e6-403a-ae54-6f128a2c88f9' (instance-00000006) May 27 21:02:38.220123 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.290011 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.290460 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.361989 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.362361 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:02:38.364772 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.444093 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.444623 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.514074 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "refresh_cache-d61bda11-c563-480f-9f5f-7d85ef081cae" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:38.514267 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquired lock "refresh_cache-d61bda11-c563-480f-9f5f-7d85ef081cae" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:38.514607 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:02:38.533357 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.533825 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:02:38.535995 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.616096 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.617091 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.647494 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:38.647760 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:38.691972 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.694228 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.716738 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Found WWN 330000000c0633167 for multipath device dm-4 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:02:38.720495 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.053s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:38.722881 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== connect_volume: return (3827ms) {'type': 'block', 'scsi_wwn': '330000000c0633167', 'path': '/dev/dm-4', 'multipath_id': '330000000c0633167'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:38.722881 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c0633167', 'path': '/dev/dm-4', 'multipath_id': '330000000c0633167'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:02:38.722881 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.527s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:38.723104 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:02:38.729091 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'flavor' on Instance uuid 698b750b-959f-4358-b7a0-5f68e76f5a4a {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:38.736155 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:38.736815 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:38.737100 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:38.737430 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:38.737769 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:38.737939 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:38.751704 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:38.751704 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:38.751704 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:38.756448 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:38.756448 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:38.756448 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:38.756448 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:38.771536 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:38.778882 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:38.786106 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.786528 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.800238 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:38.800238 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:38.800238 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:38.801870 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:38.802115 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:38.803594 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] HCTL ('15', '0', '0', 0) found on session 11 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:38.803837 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:38.811050 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:38.811050 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:38.811487 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:38.811487 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:38.812325 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.074s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:38.812325 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:38.812806 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] HCTL ('16', '0', '0', 0) found on session 12 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:38.812959 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:38.813832 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Searching for a device in session 11 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:38.814106 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:38.818924 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:02:38.820770 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:02:38.821177 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Creating image(s) May 27 21:02:38.821903 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "/opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:38.822162 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:38.822777 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:38.823304 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Searching for a device in session 12 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:38.823487 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:38.824052 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:38.826572 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:38.827400 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.862799 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.865074 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:02:38.866105 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.892215 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:38.893004 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:38.893185 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:38.893614 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No VIF found with MAC fa:16:3e:83:3a:d3, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:38.901714 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "env LANG=C uptime" returned: 0 in 0.035s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.902123 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Hypervisor/Node resource view: name=np0000001553 free_ram=11633MB free_disk=74.31045150756836GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98213) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} May 27 21:02:38.902362 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:38.913545 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.086s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:38.914074 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:38.915395 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:38.915922 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:38.920645 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:38.921209 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:38.999804 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.078s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:39.000227 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:39.040242 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk 1073741824" returned: 0 in 0.040s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:39.041163 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.125s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:39.041163 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:39.113992 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.073s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:39.114402 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:02:39.114726 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:39.137525 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:02:39.203956 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:39.204461 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Cannot resize image /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:02:39.204797 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:02:39.204953 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Ensure instance console log exists: /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:02:39.205361 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:39.205445 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:39.205591 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:39.232167 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Attempting to attach volume d6a1fc42-6b17-46f6-b4f0-a605fb6da369 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:02:39.233950 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] attach device xml: May 27 21:02:39.233950 np0000001553 nova-compute[98213]: May 27 21:02:39.233950 np0000001553 nova-compute[98213]: May 27 21:02:39.233950 np0000001553 nova-compute[98213]: May 27 21:02:39.233950 np0000001553 nova-compute[98213]: May 27 21:02:39.233950 np0000001553 nova-compute[98213]: d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:39.233950 np0000001553 nova-compute[98213]: May 27 21:02:39.233950 np0000001553 nova-compute[98213]: May 27 21:02:39.233950 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:02:39.366882 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:39.406204 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-02998646-5a99-45c6-8678-51c93757c5c3 req-c9441cef-0106-47b1-8586-953c7cc54d1f service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Received event network-changed-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:39.406338 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-02998646-5a99-45c6-8678-51c93757c5c3 req-c9441cef-0106-47b1-8586-953c7cc54d1f service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Refreshing instance network info cache due to event network-changed-9b53f972-5207-4963-8168-a2e2d0871383. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:39.406463 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-02998646-5a99-45c6-8678-51c93757c5c3 req-c9441cef-0106-47b1-8586-953c7cc54d1f service nova] Acquiring lock "refresh_cache-d61bda11-c563-480f-9f5f-7d85ef081cae" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:39.494571 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:02:39.494802 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:02:39.525360 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Updating instance_info_cache with network_info: [{"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:39.739249 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:02:39.996035 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-69187d05-5105-463f-8521-7f8620fccae0 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.059s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:39.997379 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:02:40.027719 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Releasing lock "refresh_cache-d61bda11-c563-480f-9f5f-7d85ef081cae" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:40.028120 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Instance network_info: |[{"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:02:40.028676 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-02998646-5a99-45c6-8678-51c93757c5c3 req-c9441cef-0106-47b1-8586-953c7cc54d1f service nova] Acquired lock "refresh_cache-d61bda11-c563-480f-9f5f-7d85ef081cae" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:40.028887 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-02998646-5a99-45c6-8678-51c93757c5c3 req-c9441cef-0106-47b1-8586-953c7cc54d1f service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Refreshing network info cache for port 9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:40.034511 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Start _get_guest_xml network_info=[{"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:02:40.037361 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:02:40.041506 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-613015261', uuid='d61bda11-c563-480f-9f5f-7d85ef081cae'), owner=OwnerMeta(userid='18e30c231082464ab556592986d8b793', username='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member', projectid='79fe4bede0c741bfb93a23985eeef42e', projectname='tempest-ServerBootFromVolumeStableRescueTest-1106755838'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915760.0409617) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:02:40.044708 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:02:40.046576 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:02:40.047931 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:02:40.048197 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:02:40.049389 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:02:40.050359 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:02:40.050588 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:02:40.050722 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:02:40.050911 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:02:40.051042 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:02:40.051222 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:02:40.051971 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:02:40.051971 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:02:40.051971 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:02:40.051971 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:02:40.052126 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:02:40.058040 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:40.071189 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-613015261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-613015261',id=14,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-ij4j5vks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:38Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=d61bda11-c563-480f-9f5f-7d85ef081cae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:02:40.071415 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:40.072242 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=9b53f972-5207-4963-8168-a2e2d0871383,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b53f972-52') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:40.072978 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'pci_devices' on Instance uuid d61bda11-c563-480f-9f5f-7d85ef081cae {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:40.505772 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.858s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:40.507837 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.605s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:40.538935 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-02998646-5a99-45c6-8678-51c93757c5c3 req-c9441cef-0106-47b1-8586-953c7cc54d1f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:40.577309 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] End _get_guest_xml xml= May 27 21:02:40.577309 np0000001553 nova-compute[98213]: d61bda11-c563-480f-9f5f-7d85ef081cae May 27 21:02:40.577309 np0000001553 nova-compute[98213]: instance-0000000e May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 196608 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 1 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-server-613015261 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 2026-05-27 21:02:40 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 192 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 1 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 0 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 0 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 1 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: True May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: bare May 27 21:02:40.577309 np0000001553 nova-compute[98213]: qcow2 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 1 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 0 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: virtio May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member May 27 21:02:40.577309 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:02:40.577309 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: d61bda11-c563-480f-9f5f-7d85ef081cae May 27 21:02:40.577309 np0000001553 nova-compute[98213]: d61bda11-c563-480f-9f5f-7d85ef081cae May 27 21:02:40.577309 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: hvm May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 128 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: 1 May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: Nehalem May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: May 27 21:02:40.577309 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:02:40.580361 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Preparing to wait for external event network-vif-plugged-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:02:40.580361 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:40.580361 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:40.580361 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:40.580361 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-613015261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-613015261',id=14,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-ij4j5vks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:38Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=d61bda11-c563-480f-9f5f-7d85ef081cae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:02:40.580765 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:40.582065 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=9b53f972-5207-4963-8168-a2e2d0871383,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b53f972-52') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:40.582065 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=9b53f972-5207-4963-8168-a2e2d0871383,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b53f972-52') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:02:40.582065 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:40.582276 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:40.582535 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:02:40.583906 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:40.584098 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6de86642-1dbe-5ef3-95fc-3d7f85233007', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:40.584897 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:40.585722 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:40.594282 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Deleted allocations for instance 69083572-b3e6-403a-ae54-6f128a2c88f9 May 27 21:02:40.596900 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:40.599253 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:40.599451 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b53f972-52, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:40.599882 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b53f972-52, col_values=(('qos', UUID('0e0392b6-437f-4558-b417-b7c4af8ebf3a')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:40.600065 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b53f972-52, col_values=(('external_ids', {'iface-id': '9b53f972-5207-4963-8168-a2e2d0871383', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:5c:b7', 'vm-uuid': 'd61bda11-c563-480f-9f5f-7d85ef081cae'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:40.601235 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:40.602710 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:40.612026 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:40.613453 np0000001553 nova-compute[98213]: INFO os_vif [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=9b53f972-5207-4963-8168-a2e2d0871383,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b53f972-52') May 27 21:02:40.758947 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Found WWN 330000000e3776757 for multipath device dm-6 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:02:40.759378 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:40.759560 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] <== connect_volume: return (4563ms) {'type': 'block', 'scsi_wwn': '330000000e3776757', 'path': '/dev/dm-6', 'multipath_id': '330000000e3776757'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:40.759725 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e3776757', 'path': '/dev/dm-6', 'multipath_id': '330000000e3776757'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:02:40.761654 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.374s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:40.761859 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e75d999-c6d6-489b-8483-5f3a34c5b898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:02:40.773619 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:40.774340 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:40.776005 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:40.776005 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:02:40.776400 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:40.776697 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:40.790493 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:40.790493 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:40.790493 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:40.800992 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.state = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:02:40.800992 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:02:40.800992 np0000001553 nova-compute[98213]: # END RECORD May 27 21:02:40.800992 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:40.808552 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:40.817268 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:40.826918 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:40.826918 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:40.827304 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:40.827304 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:40.827567 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.053s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:40.827567 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:40.828900 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] HCTL ('17', '0', '0', 0) found on session 15 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:40.829060 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:40.838256 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Searching for a device in session 15 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:40.838729 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e75d999-c6d6-489b-8483-5f3a34c5b898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:40.840008 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:40.840008 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:40.840327 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:40.840327 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:40.840520 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:40.840587 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:02:40.841396 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] HCTL ('18', '0', '0', 0) found on session 16 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:02:40.841495 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:02:40.852337 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Searching for a device in session 16 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:02:40.852337 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5e75d999-c6d6-489b-8483-5f3a34c5b898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:02:40.901527 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:40.901683 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:40.901961 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:40.905173 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No VIF found with MAC fa:16:3e:9e:34:0a, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:40.925155 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-02998646-5a99-45c6-8678-51c93757c5c3 req-c9441cef-0106-47b1-8586-953c7cc54d1f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:41.089011 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-02998646-5a99-45c6-8678-51c93757c5c3 req-c9441cef-0106-47b1-8586-953c7cc54d1f service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Updated VIF entry in instance network info cache for port 9b53f972-5207-4963-8168-a2e2d0871383. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:02:41.089304 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-02998646-5a99-45c6-8678-51c93757c5c3 req-c9441cef-0106-47b1-8586-953c7cc54d1f service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Updating instance_info_cache with network_info: [{"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:41.270175 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-825501870',display_name='tempest-ServerStableDeviceRescueTest-server-825501870',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverstabledevicerescuetest-server-825501870',id=2,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGg1/9242vIbx6vjuoAaueOs/ycrtrXLSIRHl3kBo44NyGftUde+Q5/v9QeELCwC81jYOXCHSIshR3t5+UTnEBpZoHz1vAbfMO55j2RFIjE2iyvknOrzgj26SooPwTYUvA==',key_name='tempest-keypair-85036239',keypairs=,launch_index=0,launched_at=2026-05-27T21:01:23Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='92da496690954c8fb9c6eb722b956485',ramdisk_id='',reservation_id='r-x4fpd3kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-382424917',owner_user_name='tempest-ServerStableDeviceRescueTest-382424917-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e7f263d257406d8c7b8ab607d0e609',uuid=22e422c7-47a4-4619-92a8-b05b73989943,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "vif_mac": "fa:16:3e:6e:ec:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:02:41.270175 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Converting VIF {"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "vif_mac": "fa:16:3e:6e:ec:22"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:41.270644 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:ec:22,bridge_name='br-int',has_traffic_filtering=True,id=b8698723-2577-4f03-aa99-ea06a904c148,network=Network(3506bf24-d962-44d8-ae8b-5f10ebe7fa2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8698723-25') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:41.270644 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'pci_devices' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:41.591807 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-02998646-5a99-45c6-8678-51c93757c5c3 req-c9441cef-0106-47b1-8586-953c7cc54d1f service nova] Releasing lock "refresh_cache-d61bda11-c563-480f-9f5f-7d85ef081cae" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:41.594195 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance f4397c41-4087-4367-b1ac-46e8cc475772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.594195 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 22e422c7-47a4-4619-92a8-b05b73989943 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.594317 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance f0c8ea02-9725-47ed-b34b-13ea3552d09b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.594410 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 1597a38f-a6a7-45bd-86ec-3938926c5cc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.594509 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance aac9c5e0-da16-44ef-b255-53b21d0cc63d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.594623 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.594706 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 950bfe97-53fd-4086-bfa5-69ea3a75c088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.594902 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.596204 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance a6108bdf-d518-447f-927d-43d7fa6456e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.596204 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 698b750b-959f-4358-b7a0-5f68e76f5a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.596204 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.596204 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance d61bda11-c563-480f-9f5f-7d85ef081cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:02:41.596204 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} May 27 21:02:41.596204 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Final resource view: name=np0000001553 phys_ram=24030MB used_ram=2816MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 21:02:38 up 28 min, 2 users, load average: 8.67, 3.93, 1.79\n', 'num_instances': '12', 'num_vm_active': '11', 'num_task_None': '9', 'num_os_type_None': '12', 'num_proj_79fe4bede0c741bfb93a23985eeef42e': '3', 'io_workload': '3', 'num_task_rescuing': '1', 'num_proj_92da496690954c8fb9c6eb722b956485': '1', 'num_proj_b562b6a1ba2b4c3ab101af22f9d04713': '2', 'num_proj_251237411f6e4bb49303c88852d6e9a1': '3', 'num_proj_3b0d658b24414d8aadb0cb04849300a3': '2', 'num_task_resize_prep': '1', 'num_proj_3811fd8e033640e18a7080fe0a65d975': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} May 27 21:02:41.604931 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-987be98e-6916-42fb-a1a4-4b89feb65c3f tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Lock "69083572-b3e6-403a-ae54-6f128a2c88f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.089s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:41.704480 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:41.775247 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Object Instance<22e422c7-47a4-4619-92a8-b05b73989943> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:41.775247 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] End _get_guest_xml xml= May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 22e422c7-47a4-4619-92a8-b05b73989943 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: instance-00000002 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 196608 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 1 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: tempest-ServerStableDeviceRescueTest-server-825501870 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 2026-05-27 21:02:35 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 192 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 1 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 0 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 0 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 1 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: True May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: bare May 27 21:02:41.775247 np0000001553 nova-compute[98213]: qcow2 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 1 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 0 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: ide May 27 21:02:41.775247 np0000001553 nova-compute[98213]: virtio May 27 21:02:41.775247 np0000001553 nova-compute[98213]: pc May 27 21:02:41.775247 np0000001553 nova-compute[98213]: virtio May 27 21:02:41.775247 np0000001553 nova-compute[98213]: virtio May 27 21:02:41.775247 np0000001553 nova-compute[98213]: virtio May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: tempest-ServerStableDeviceRescueTest-382424917-project-member May 27 21:02:41.775247 np0000001553 nova-compute[98213]: tempest-ServerStableDeviceRescueTest-382424917 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:02:41.775247 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 22e422c7-47a4-4619-92a8-b05b73989943 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 22e422c7-47a4-4619-92a8-b05b73989943 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: hvm May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 128 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: 1 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: Nehalem May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: May 27 21:02:41.775247 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:02:41.781313 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:02:41.781313 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Instance destroyed successfully. May 27 21:02:42.131494 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:42.131672 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:42.131810 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No VIF found with MAC fa:16:3e:ad:5c:b7, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:42.132374 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Using config drive May 27 21:02:42.267970 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:02:42.268186 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:02:42.317621 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00036654699988503125 future=) was cancelled during its delay period, skipping {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:42.317954 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:42.317954 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.290295776999983 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:42.318054 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.29017210799997883 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:42.457913 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:42.461988 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4134ccbe-f568-4af4-9fe0-e0e136ae6868 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.268s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:42.608634 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003439939998770569 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:42.609013 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:42.609118 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.73895669500007 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:42.609317 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=6.738751044000082 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:42.610406 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:42.610677 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] VM Stopped (Lifecycle Event) May 27 21:02:42.640160 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:42.770425 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:02:42.793450 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Creating config drive at /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk.config May 27 21:02:42.795101 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Found WWN 330000000da4990e6 for multipath device dm-7 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:02:42.798019 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:42.798019 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] <== connect_volume: return (5409ms) {'type': 'block', 'scsi_wwn': '330000000da4990e6', 'path': '/dev/dm-7', 'multipath_id': '330000000da4990e6'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:42.798019 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000da4990e6', 'path': '/dev/dm-7', 'multipath_id': '330000000da4990e6'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:02:42.801589 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lazy-loading 'flavor' on Instance uuid d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:42.806924 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp7ajx9dr {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:42.853254 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp7ajx9dr" returned: 0 in 0.045s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:43.116486 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-aab52233-626e-4d78-be36-d4a4478e8353 None None] [instance: 95d3c2a3-6ad3-4458-8771-4f95b37ad16c] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:43.278643 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Compute_service record updated for np0000001553:np0000001553 {{(pid=98213) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} May 27 21:02:43.279662 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.772s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:43.280250 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 40.38 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:02:43.306891 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Attempting to attach volume 5e75d999-c6d6-489b-8483-5f3a34c5b898 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:02:43.310402 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] attach device xml: May 27 21:02:43.310402 np0000001553 nova-compute[98213]: May 27 21:02:43.310402 np0000001553 nova-compute[98213]: May 27 21:02:43.310402 np0000001553 nova-compute[98213]: May 27 21:02:43.310402 np0000001553 nova-compute[98213]: May 27 21:02:43.310402 np0000001553 nova-compute[98213]: 5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:43.310402 np0000001553 nova-compute[98213]: May 27 21:02:43.310402 np0000001553 nova-compute[98213]: May 27 21:02:43.310402 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:02:43.314613 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:43.314772 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:43.314914 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:43.315053 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:43.315220 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] No VIF found with MAC fa:16:3e:6e:ec:22, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:43.315901 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Using config drive May 27 21:02:43.353075 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Stashing vm_state: active {{(pid=98213) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} May 27 21:02:43.440289 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:43.481869 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:43.485232 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:43.631579 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:43.639682 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:43.649459 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-216fc411-c9ef-40ba-acc8-6dcd091812d9 req-26a95561-b10a-4761-99b0-1e28b8c7e118 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Received event network-vif-plugged-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:43.649766 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-216fc411-c9ef-40ba-acc8-6dcd091812d9 req-26a95561-b10a-4761-99b0-1e28b8c7e118 service nova] Acquiring lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:43.649996 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-216fc411-c9ef-40ba-acc8-6dcd091812d9 req-26a95561-b10a-4761-99b0-1e28b8c7e118 service nova] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:43.650280 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-216fc411-c9ef-40ba-acc8-6dcd091812d9 req-26a95561-b10a-4761-99b0-1e28b8c7e118 service nova] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:43.650361 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-216fc411-c9ef-40ba-acc8-6dcd091812d9 req-26a95561-b10a-4761-99b0-1e28b8c7e118 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Processing event network-vif-plugged-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:02:43.681000 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:43.756606 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "a6108bdf-d518-447f-927d-43d7fa6456e2" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:43.756818 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:43.820708 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'ec2_ids' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:43.916902 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:43.917129 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:44.261129 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Detaching volume d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:44.318809 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: a6108bdf-d518-447f-927d-43d7fa6456e2] Attempting to driver detach volume d6a1fc42-6b17-46f6-b4f0-a605fb6da369 from mountpoint /dev/vdb May 27 21:02:44.324991 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Object Instance<22e422c7-47a4-4619-92a8-b05b73989943> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:44.327952 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'keypairs' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:44.331354 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Found disk vdb by alias ua-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:44.336000 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Found disk vdb by alias ua-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:44.336134 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Attempting to detach device vdb from instance a6108bdf-d518-447f-927d-43d7fa6456e2 from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:02:44.336425 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] detach device xml: May 27 21:02:44.336425 np0000001553 nova-compute[98213]: May 27 21:02:44.336425 np0000001553 nova-compute[98213]: May 27 21:02:44.336425 np0000001553 nova-compute[98213]: May 27 21:02:44.336425 np0000001553 nova-compute[98213]: May 27 21:02:44.336425 np0000001553 nova-compute[98213]: d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:44.336425 np0000001553 nova-compute[98213]: May 27 21:02:44.336425 np0000001553 nova-compute[98213]:
May 27 21:02:44.336425 np0000001553 nova-compute[98213]: May 27 21:02:44.336425 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:44.344978 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully detached device vdb from instance a6108bdf-d518-447f-927d-43d7fa6456e2 from the persistent domain config. May 27 21:02:44.345094 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] (1/8): Attempting to detach device vdb with device alias ua-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 from instance a6108bdf-d518-447f-927d-43d7fa6456e2 from the live domain config. {{(pid=98213) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} May 27 21:02:44.345463 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] detach device xml: May 27 21:02:44.345463 np0000001553 nova-compute[98213]: May 27 21:02:44.345463 np0000001553 nova-compute[98213]: May 27 21:02:44.345463 np0000001553 nova-compute[98213]: May 27 21:02:44.345463 np0000001553 nova-compute[98213]: May 27 21:02:44.345463 np0000001553 nova-compute[98213]: d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:44.345463 np0000001553 nova-compute[98213]: May 27 21:02:44.345463 np0000001553 nova-compute[98213]:
May 27 21:02:44.345463 np0000001553 nova-compute[98213]: May 27 21:02:44.345463 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:44.433270 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:02:44.433270 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Claim successful on node np0000001553 May 27 21:02:44.466866 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:44.467087 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] VM Started (Lifecycle Event) May 27 21:02:44.468845 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:02:44.471462 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:02:44.480735 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Instance spawned successfully. May 27 21:02:44.480735 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:02:44.773979 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:44.828512 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Object Instance<22e422c7-47a4-4619-92a8-b05b73989943> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:44.831799 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:44.944074 np0000001553 nova-compute[98213]: INFO nova.compute.resource_tracker [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating resource usage from migration 8a95cf4e-c2e9-4789-8ca0-4a57b8fb9f76 May 27 21:02:44.959897 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Creating config drive at /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.config.rescue May 27 21:02:44.967381 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 for instance a6108bdf-d518-447f-927d-43d7fa6456e2 {{(pid=98213) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} May 27 21:02:44.967846 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc7t450c7 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:44.985467 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:44.992051 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:44.997426 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:44.997613 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:44.997992 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:44.998265 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:44.998627 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:44.998937 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:02:45.030882 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc7t450c7" returned: 0 in 0.063s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:45.212813 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:45.212969 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:45.213126 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:02:45.213291 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] No VIF found with MAC fa:16:3e:2b:af:36, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:02:45.503700 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:02:45.507332 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:45.507332 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] VM Paused (Lifecycle Event) May 27 21:02:45.507456 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Took 6.69 seconds to spawn the instance on the hypervisor. May 27 21:02:45.507929 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:45.549685 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:45.585786 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:45.588918 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:45.603896 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:45.680211 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:45.973185 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:02:45.973185 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:02:46.009892 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:46.015708 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:46.015754 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] VM Resumed (Lifecycle Event) May 27 21:02:46.024848 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Took 12.69 seconds to build instance. May 27 21:02:46.061237 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:46.067184 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:46.089396 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:46.116722 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9755cb5-b68c-4f16-b859-685ec2dfe89e req-657da361-d7ea-440e-a673-d240181f3872 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Received event network-vif-plugged-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:46.117024 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9755cb5-b68c-4f16-b859-685ec2dfe89e req-657da361-d7ea-440e-a673-d240181f3872 service nova] Acquiring lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:46.117300 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9755cb5-b68c-4f16-b859-685ec2dfe89e req-657da361-d7ea-440e-a673-d240181f3872 service nova] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:46.117461 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c9755cb5-b68c-4f16-b859-685ec2dfe89e req-657da361-d7ea-440e-a673-d240181f3872 service nova] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:46.117650 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c9755cb5-b68c-4f16-b859-685ec2dfe89e req-657da361-d7ea-440e-a673-d240181f3872 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] No waiting events found dispatching network-vif-plugged-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:46.117835 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-c9755cb5-b68c-4f16-b859-685ec2dfe89e req-657da361-d7ea-440e-a673-d240181f3872 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Received unexpected event network-vif-plugged-9b53f972-5207-4963-8168-a2e2d0871383 for instance with vm_state active and task_state None. May 27 21:02:46.133317 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-53576cc5-19fa-42d6-981c-b112ee770958 req-83dd94a0-b4c3-4c35-a431-aa4cfb33a953 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:46.134135 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-53576cc5-19fa-42d6-981c-b112ee770958 req-83dd94a0-b4c3-4c35-a431-aa4cfb33a953 service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:46.134855 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-53576cc5-19fa-42d6-981c-b112ee770958 req-83dd94a0-b4c3-4c35-a431-aa4cfb33a953 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:46.135022 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-53576cc5-19fa-42d6-981c-b112ee770958 req-83dd94a0-b4c3-4c35-a431-aa4cfb33a953 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:46.135329 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-53576cc5-19fa-42d6-981c-b112ee770958 req-83dd94a0-b4c3-4c35-a431-aa4cfb33a953 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] No waiting events found dispatching network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:46.135575 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-53576cc5-19fa-42d6-981c-b112ee770958 req-83dd94a0-b4c3-4c35-a431-aa4cfb33a953 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received unexpected event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 for instance with vm_state active and task_state rescuing. May 27 21:02:46.479967 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:02:46.518700 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:46.520994 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:46.526939 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.214s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:46.555102 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-8dde779b-514a-46c0-89d1-84b3fe0382aa tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:46.647203 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:46.709710 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:46.805094 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c967be00-f66c-4c0c-a29a-96e464785b6b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.167s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:46.986890 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.070s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:46.987426 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Migrating May 27 21:02:46.987426 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:46.987426 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:47.023342 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Received event ua-d6a1fc42-6b17-46f6-b4f0-a605fb6da369> from libvirt while the driver is waiting for it; dispatched. {{(pid=98213) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} May 27 21:02:47.024712 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for 22e422c7-47a4-4619-92a8-b05b73989943 due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:02:47.024898 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:47.025050 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] VM Resumed (Lifecycle Event) May 27 21:02:47.028391 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully detached device vdb from instance a6108bdf-d518-447f-927d-43d7fa6456e2 from the live domain config. May 27 21:02:47.298592 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:47.494017 np0000001553 nova-compute[98213]: INFO nova.compute.rpcapi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72 May 27 21:02:47.494743 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:47.495011 np0000001553 nova-compute[98213]: DEBUG nova.compute.rpcapi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98213) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} May 27 21:02:47.528110 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:47.532059 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:47.584024 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Detected multiple connections on this host for volume: d6a1fc42-6b17-46f6-b4f0-a605fb6da369, skipping target disconnect. May 27 21:02:48.025644 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:48.026096 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquired lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:48.026096 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:02:48.035134 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:48.035350 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] VM Started (Lifecycle Event) May 27 21:02:48.075207 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:48.175266 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'flavor' on Instance uuid a6108bdf-d518-447f-927d-43d7fa6456e2 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:48.179769 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Unrescuing May 27 21:02:48.180095 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:48.180095 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquired lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:48.180206 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:02:48.229126 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6762b46c-766d-409d-97dd-b6faeaf652a7 req-40fb8322-871b-493d-bbf5-6cc6c08a10c3 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:48.230423 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6762b46c-766d-409d-97dd-b6faeaf652a7 req-40fb8322-871b-493d-bbf5-6cc6c08a10c3 service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:48.230685 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6762b46c-766d-409d-97dd-b6faeaf652a7 req-40fb8322-871b-493d-bbf5-6cc6c08a10c3 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:48.230903 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6762b46c-766d-409d-97dd-b6faeaf652a7 req-40fb8322-871b-493d-bbf5-6cc6c08a10c3 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:48.231012 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6762b46c-766d-409d-97dd-b6faeaf652a7 req-40fb8322-871b-493d-bbf5-6cc6c08a10c3 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] No waiting events found dispatching network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:48.231213 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-6762b46c-766d-409d-97dd-b6faeaf652a7 req-40fb8322-871b-493d-bbf5-6cc6c08a10c3 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received unexpected event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:48.514905 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:48.515166 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:48.528484 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:48.537779 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:48.541036 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:48.585707 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] instance snapshotting May 27 21:02:48.611843 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:48.682495 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:48.733059 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Beginning live snapshot process May 27 21:02:48.739188 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c6117662-17a3-41b7-84fd-5db23c9203b6 req-f7d9e4fd-2a3c-4ed9-aab8-b4422e329bc3 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-changed-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:48.739188 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c6117662-17a3-41b7-84fd-5db23c9203b6 req-f7d9e4fd-2a3c-4ed9-aab8-b4422e329bc3 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Refreshing instance network info cache due to event network-changed-b8698723-2577-4f03-aa99-ea06a904c148. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:48.739188 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c6117662-17a3-41b7-84fd-5db23c9203b6 req-f7d9e4fd-2a3c-4ed9-aab8-b4422e329bc3 service nova] Acquiring lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:48.934396 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:49.019103 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Detaching volume 5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:49.045333 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] During sync_power_state the instance has a pending task (unrescuing). Skip. May 27 21:02:49.080063 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Attempting to driver detach volume 5e75d999-c6d6-489b-8483-5f3a34c5b898 from mountpoint /dev/vdb May 27 21:02:49.083649 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Found disk vdb by alias ua-5e75d999-c6d6-489b-8483-5f3a34c5b898 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:49.086916 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Found disk vdb by alias ua-5e75d999-c6d6-489b-8483-5f3a34c5b898 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:49.086916 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Attempting to detach device vdb from instance d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:02:49.086916 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] detach device xml: May 27 21:02:49.086916 np0000001553 nova-compute[98213]: May 27 21:02:49.086916 np0000001553 nova-compute[98213]: May 27 21:02:49.086916 np0000001553 nova-compute[98213]: May 27 21:02:49.086916 np0000001553 nova-compute[98213]: May 27 21:02:49.086916 np0000001553 nova-compute[98213]: 5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:49.086916 np0000001553 nova-compute[98213]: May 27 21:02:49.086916 np0000001553 nova-compute[98213]:
May 27 21:02:49.086916 np0000001553 nova-compute[98213]: May 27 21:02:49.086916 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:49.094703 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Successfully detached device vdb from instance d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d from the persistent domain config. May 27 21:02:49.094913 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] (1/8): Attempting to detach device vdb with device alias ua-5e75d999-c6d6-489b-8483-5f3a34c5b898 from instance d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d from the live domain config. {{(pid=98213) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} May 27 21:02:49.095199 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] detach device xml: May 27 21:02:49.095199 np0000001553 nova-compute[98213]: May 27 21:02:49.095199 np0000001553 nova-compute[98213]: May 27 21:02:49.095199 np0000001553 nova-compute[98213]: May 27 21:02:49.095199 np0000001553 nova-compute[98213]: May 27 21:02:49.095199 np0000001553 nova-compute[98213]: 5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:49.095199 np0000001553 nova-compute[98213]: May 27 21:02:49.095199 np0000001553 nova-compute[98213]:
May 27 21:02:49.095199 np0000001553 nova-compute[98213]: May 27 21:02:49.095199 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:49.115663 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:49.120755 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating instance_info_cache with network_info: [{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:49.181212 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b0ff5e02-1e1d-4f2f-bd2a-73a4489345ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "a6108bdf-d518-447f-927d-43d7fa6456e2" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 5.424s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:49.303225 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updating instance_info_cache with network_info: [{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:49.322351 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:49.322590 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:49.348474 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003459409999777563 future=) was cancelled during its delay period, skipping {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:49.348568 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:49.348697 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.0367533840001215 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:49.349051 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=1.036398165000037 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:49.623946 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Releasing lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:49.707709 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Received event ua-5e75d999-c6d6-489b-8483-5f3a34c5b898> from libvirt while the driver is waiting for it; dispatched. {{(pid=98213) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} May 27 21:02:49.709816 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5e75d999-c6d6-489b-8483-5f3a34c5b898 for instance d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d {{(pid=98213) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} May 27 21:02:49.712477 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Successfully detached device vdb from instance d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d from the live domain config. May 27 21:02:49.805933 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Releasing lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:49.806457 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'flavor' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:49.807574 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c6117662-17a3-41b7-84fd-5db23c9203b6 req-f7d9e4fd-2a3c-4ed9-aab8-b4422e329bc3 service nova] Acquired lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:49.807813 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-c6117662-17a3-41b7-84fd-5db23c9203b6 req-f7d9e4fd-2a3c-4ed9-aab8-b4422e329bc3 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Refreshing network info cache for port b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:49.825102 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Detaching volume d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:49.879746 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Attempting to driver detach volume d6a1fc42-6b17-46f6-b4f0-a605fb6da369 from mountpoint /dev/vdb May 27 21:02:49.883089 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Found disk vdb by alias ua-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:49.884047 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Found disk vdb by alias ua-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:49.884185 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Attempting to detach device vdb from instance 698b750b-959f-4358-b7a0-5f68e76f5a4a from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:02:49.884451 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] detach device xml: May 27 21:02:49.884451 np0000001553 nova-compute[98213]: May 27 21:02:49.884451 np0000001553 nova-compute[98213]: May 27 21:02:49.884451 np0000001553 nova-compute[98213]: May 27 21:02:49.884451 np0000001553 nova-compute[98213]: May 27 21:02:49.884451 np0000001553 nova-compute[98213]: d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:49.884451 np0000001553 nova-compute[98213]: May 27 21:02:49.884451 np0000001553 nova-compute[98213]:
May 27 21:02:49.884451 np0000001553 nova-compute[98213]: May 27 21:02:49.884451 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:49.888472 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully detached device vdb from instance 698b750b-959f-4358-b7a0-5f68e76f5a4a from the persistent domain config. May 27 21:02:49.888539 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] (1/8): Attempting to detach device vdb with device alias ua-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 from instance 698b750b-959f-4358-b7a0-5f68e76f5a4a from the live domain config. {{(pid=98213) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} May 27 21:02:49.888999 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] detach device xml: May 27 21:02:49.888999 np0000001553 nova-compute[98213]: May 27 21:02:49.888999 np0000001553 nova-compute[98213]: May 27 21:02:49.888999 np0000001553 nova-compute[98213]: May 27 21:02:49.888999 np0000001553 nova-compute[98213]: May 27 21:02:49.888999 np0000001553 nova-compute[98213]: d6a1fc42-6b17-46f6-b4f0-a605fb6da369 May 27 21:02:49.888999 np0000001553 nova-compute[98213]: May 27 21:02:49.888999 np0000001553 nova-compute[98213]:
May 27 21:02:49.888999 np0000001553 nova-compute[98213]: May 27 21:02:49.888999 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:49.983117 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:50.122183 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:02:50.246937 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk --force-share --output=json -f qcow2 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:50.259531 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Detected multiple connections on this host for volume: 5e75d999-c6d6-489b-8483-5f3a34c5b898, skipping target disconnect. May 27 21:02:50.313348 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-c6117662-17a3-41b7-84fd-5db23c9203b6 req-f7d9e4fd-2a3c-4ed9-aab8-b4422e329bc3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:50.333692 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk --force-share --output=json -f qcow2" returned: 0 in 0.087s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:50.334733 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk --force-share --output=json -f qcow2 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:50.347974 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:50.370551 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:50.381429 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:50.386403 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006011189998389455 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:50.386847 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:50.386959 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:50.387103 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] VM Stopped (Lifecycle Event) May 27 21:02:50.407623 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:50.418734 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk --force-share --output=json -f qcow2" returned: 0 in 0.084s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:50.420113 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:50.425290 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:02:50.426894 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:50.511513 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.084s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:50.511935 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx_n0cvgn/6e5f3332fa764ea3b78d133b34692746.delta 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:50.554614 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx_n0cvgn/6e5f3332fa764ea3b78d133b34692746.delta 1073741824" returned: 0 in 0.042s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:50.555748 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Quiescing instance not available: QEMU guest agent is not enabled. May 27 21:02:50.606820 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:50.650353 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-23721812-af4d-4a85-9666-332bede75429 req-30a10c48-a8b0-46ba-a8db-3d7fab7defdf service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:50.653936 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-23721812-af4d-4a85-9666-332bede75429 req-30a10c48-a8b0-46ba-a8db-3d7fab7defdf service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:50.655108 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-23721812-af4d-4a85-9666-332bede75429 req-30a10c48-a8b0-46ba-a8db-3d7fab7defdf service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:50.655336 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-23721812-af4d-4a85-9666-332bede75429 req-30a10c48-a8b0-46ba-a8db-3d7fab7defdf service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:50.655611 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-23721812-af4d-4a85-9666-332bede75429 req-30a10c48-a8b0-46ba-a8db-3d7fab7defdf service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] No waiting events found dispatching network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:50.655875 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-23721812-af4d-4a85-9666-332bede75429 req-30a10c48-a8b0-46ba-a8db-3d7fab7defdf service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received unexpected event network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:50.788046 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-c6117662-17a3-41b7-84fd-5db23c9203b6 req-f7d9e4fd-2a3c-4ed9-aab8-b4422e329bc3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:50.804978 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c0c4371e-f75a-4bfb-a5b7-53f3b2bbb604 req-7969ff8c-580b-45e9-9abc-f70ddf144700 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-changed-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:50.805792 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c0c4371e-f75a-4bfb-a5b7-53f3b2bbb604 req-7969ff8c-580b-45e9-9abc-f70ddf144700 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Refreshing instance network info cache due to event network-changed-b8698723-2577-4f03-aa99-ea06a904c148. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:02:50.805938 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c0c4371e-f75a-4bfb-a5b7-53f3b2bbb604 req-7969ff8c-580b-45e9-9abc-f70ddf144700 service nova] Acquiring lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:50.828375 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lazy-loading 'flavor' on Instance uuid d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:50.891041 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-21c4e852-fa4f-48a6-95ab-e85663c789de None None] [instance: 69083572-b3e6-403a-ae54-6f128a2c88f9] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:50.893827 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98213) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} May 27 21:02:50.896160 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Skipping quiescing instance: QEMU guest agent is not enabled. May 27 21:02:50.909224 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.99970122700006 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:50.911185 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.997683301000052 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:50.911309 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99754873300003 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:50.917646 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Instance destroyed successfully. May 27 21:02:50.918256 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'numa_topology' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:50.950527 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-c6117662-17a3-41b7-84fd-5db23c9203b6 req-f7d9e4fd-2a3c-4ed9-aab8-b4422e329bc3 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updated VIF entry in instance network info cache for port b8698723-2577-4f03-aa99-ea06a904c148. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:02:50.950981 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-c6117662-17a3-41b7-84fd-5db23c9203b6 req-f7d9e4fd-2a3c-4ed9-aab8-b4422e329bc3 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updating instance_info_cache with network_info: [{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:50.952609 np0000001553 nova-compute[98213]: DEBUG nova.privsep.utils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98213) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} May 27 21:02:50.952848 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx_n0cvgn/6e5f3332fa764ea3b78d133b34692746.delta /opt/stack/data/nova/instances/snapshots/tmpx_n0cvgn/6e5f3332fa764ea3b78d133b34692746 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:51.031688 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx_n0cvgn/6e5f3332fa764ea3b78d133b34692746.delta /opt/stack/data/nova/instances/snapshots/tmpx_n0cvgn/6e5f3332fa764ea3b78d133b34692746" returned: 0 in 0.078s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:51.032261 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Snapshot extracted, beginning image upload May 27 21:02:51.143220 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Starting migrate_disk_and_power_off {{(pid=98213) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}} May 27 21:02:51.171964 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.178306 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.202287 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.204068 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.234383 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.235774 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.420620 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Object Instance<22e422c7-47a4-4619-92a8-b05b73989943> lazy-loaded attributes: flavor,numa_topology {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:02:51.452954 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c6117662-17a3-41b7-84fd-5db23c9203b6 req-f7d9e4fd-2a3c-4ed9-aab8-b4422e329bc3 service nova] Releasing lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:51.453547 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c0c4371e-f75a-4bfb-a5b7-53f3b2bbb604 req-7969ff8c-580b-45e9-9abc-f70ddf144700 service nova] Acquired lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:51.453731 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-c0c4371e-f75a-4bfb-a5b7-53f3b2bbb604 req-7969ff8c-580b-45e9-9abc-f70ddf144700 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Refreshing network info cache for port b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:02:51.573532 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999661734000028 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:51.574828 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance destroyed successfully. May 27 21:02:51.575896 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-636487866',display_name='tempest-ServerActionsTestOtherB-server-636487866',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serveractionstestotherb-server-636487866',id=9,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP37vEU7tk6IZLG6nGgYJrRWC1XysqG9qhj9f6Ts3gEcgfRgE2Kuebb5geAJYt0lQJDqjDBxoFON2pCBOOFgVRPjkb/YhHT2yjUMuBmc0jN1WzS2xreRxA0w+OzMqxnUwQ==',key_name='tempest-keypair-736936884',keypairs=,launch_index=0,launched_at=2026-05-27T21:01:49Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3811fd8e033640e18a7080fe0a65d975',ramdisk_id='',reservation_id='r-004tqvtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1747713240',owner_user_name='tempest-ServerActionsTestOtherB-1747713240-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='606bde5cb68847cc8b7b2af092fc6bd6',uuid=950bfe97-53fd-4086-bfa5-69ea3a75c088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2030006956-network", "vif_mac": "fa:16:3e:83:3a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:02:51.576260 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converting VIF {"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2030006956-network", "vif_mac": "fa:16:3e:83:3a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:51.577021 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:51.577381 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:02:51.579976 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.580197 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c501903-cc, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:51.581290 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.582212 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:51.586578 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.587668 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.587831 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb3fc696-1e61-43f8-a153-57918b4a303d) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:51.588545 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.589344 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:51.593884 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.596554 np0000001553 nova-compute[98213]: INFO os_vif [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') May 27 21:02:51.600325 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:02:51.600325 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:51.600325 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:51.600325 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:51.600325 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:02:51.600325 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:02:51.633375 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:51.633375 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:51.633375 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:51.633375 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:02:51.633375 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '17')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:02:51.634082 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '18')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:02:51.636745 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Resulting device map defaultdict(. at 0x79ced0202fc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'): ({'sdi'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:02:51.636925 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Removing multipathed devices sdh, sdi {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:02:51.637206 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Flush multipath device 330000000c5130650 {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:02:51.669552 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:02:51.714289 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.728331 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:02:51.779595 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:02:51.779752 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:02:51.781040 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:02:51.791584 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:02:51.791822 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:02:51.802134 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:51.834682 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-cc9ad751-12e5-4c1f-ad7a-b3b194505838 tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.319s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:51.846010 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] May 27 21:02:51.846010 np0000001553 nova-compute[98213]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] successful. May 27 21:02:51.846010 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:51.870377 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:51.880916 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:51.912324 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.919208 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] May 27 21:02:51.919208 np0000001553 nova-compute[98213]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] successful. May 27 21:02:51.919208 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:51.941442 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.941442 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:51.941442 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:51.941442 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] <== disconnect_volume: return (342ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:51.941442 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:02:51.941626 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:51.948263 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:51.966289 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-c0c4371e-f75a-4bfb-a5b7-53f3b2bbb604 req-7969ff8c-580b-45e9-9abc-f70ddf144700 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:52.038553 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:52.047572 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:52.048058 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:52.140232 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:52.141083 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:02:52.141718 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088_resize/disk /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:52.240642 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "cp -r /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088_resize/disk /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk" returned: 0 in 0.098s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:52.244165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088_resize/disk.config /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.config {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:52.293514 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "cp -r /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088_resize/disk.config /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.config" returned: 0 in 0.050s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:52.294169 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088_resize/disk.info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:52.315408 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:52.344902 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "cp -r /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088_resize/disk.info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info" returned: 0 in 0.051s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:52.349485 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:52.421446 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-c0c4371e-f75a-4bfb-a5b7-53f3b2bbb604 req-7969ff8c-580b-45e9-9abc-f70ddf144700 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:52.598965 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-c0c4371e-f75a-4bfb-a5b7-53f3b2bbb604 req-7969ff8c-580b-45e9-9abc-f70ddf144700 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updated VIF entry in instance network info cache for port b8698723-2577-4f03-aa99-ea06a904c148. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:02:52.600495 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-c0c4371e-f75a-4bfb-a5b7-53f3b2bbb604 req-7969ff8c-580b-45e9-9abc-f70ddf144700 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updating instance_info_cache with network_info: [{"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] No waiting events found dispatching network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received unexpected event network-vif-unplugged-b8698723-2577-4f03-aa99-ea06a904c148 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] No waiting events found dispatching network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received unexpected event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:52.732191 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:52.732693 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:52.732974 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] No waiting events found dispatching network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:52.733247 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-6b0025f8-0dd5-4a90-aab9-db1d7d60836b req-59953ed9-c76a-42a3-bf4c-2f359493c4b7 service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received unexpected event network-vif-plugged-b8698723-2577-4f03-aa99-ea06a904c148 for instance with vm_state rescued and task_state unrescuing. May 27 21:02:52.863275 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-fafcf2f0-c32d-4144-958f-862af60a16d9 tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:52.863834 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for 22e422c7-47a4-4619-92a8-b05b73989943 due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:02:52.864114 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:52.864294 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] VM Resumed (Lifecycle Event) May 27 21:02:53.013102 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:53.013295 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:53.079970 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:53.103522 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c0c4371e-f75a-4bfb-a5b7-53f3b2bbb604 req-7969ff8c-580b-45e9-9abc-f70ddf144700 service nova] Releasing lock "refresh_cache-22e422c7-47a4-4619-92a8-b05b73989943" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:53.301805 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 for instance 698b750b-959f-4358-b7a0-5f68e76f5a4a {{(pid=98213) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} May 27 21:02:53.370861 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:53.377032 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:53.514376 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:53.514655 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:53.517344 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Detaching volume 5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:53.592599 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Attempting to driver detach volume 5e75d999-c6d6-489b-8483-5f3a34c5b898 from mountpoint /dev/vdb May 27 21:02:53.598851 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Found disk vdb by alias ua-5e75d999-c6d6-489b-8483-5f3a34c5b898 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:53.599899 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Found disk vdb by alias ua-5e75d999-c6d6-489b-8483-5f3a34c5b898 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:02:53.600087 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Attempting to detach device vdb from instance aac9c5e0-da16-44ef-b255-53b21d0cc63d from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:02:53.600357 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] detach device xml: May 27 21:02:53.600357 np0000001553 nova-compute[98213]: May 27 21:02:53.600357 np0000001553 nova-compute[98213]: May 27 21:02:53.600357 np0000001553 nova-compute[98213]: May 27 21:02:53.600357 np0000001553 nova-compute[98213]: May 27 21:02:53.600357 np0000001553 nova-compute[98213]: 5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:53.600357 np0000001553 nova-compute[98213]: May 27 21:02:53.600357 np0000001553 nova-compute[98213]:
May 27 21:02:53.600357 np0000001553 nova-compute[98213]: May 27 21:02:53.600357 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:53.607341 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Successfully detached device vdb from instance aac9c5e0-da16-44ef-b255-53b21d0cc63d from the persistent domain config. May 27 21:02:53.607480 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] (1/8): Attempting to detach device vdb with device alias ua-5e75d999-c6d6-489b-8483-5f3a34c5b898 from instance aac9c5e0-da16-44ef-b255-53b21d0cc63d from the live domain config. {{(pid=98213) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} May 27 21:02:53.607711 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] detach device xml: May 27 21:02:53.607711 np0000001553 nova-compute[98213]: May 27 21:02:53.607711 np0000001553 nova-compute[98213]: May 27 21:02:53.607711 np0000001553 nova-compute[98213]: May 27 21:02:53.607711 np0000001553 nova-compute[98213]: May 27 21:02:53.607711 np0000001553 nova-compute[98213]: 5e75d999-c6d6-489b-8483-5f3a34c5b898 May 27 21:02:53.607711 np0000001553 nova-compute[98213]: May 27 21:02:53.607711 np0000001553 nova-compute[98213]:
May 27 21:02:53.607711 np0000001553 nova-compute[98213]: May 27 21:02:53.607711 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:02:53.884958 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:02:53.885118 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] VM Started (Lifecycle Event) May 27 21:02:54.069379 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Port 8c501903-cc36-46d4-9ca9-87394e07d00c binding to destination host np0000001553 is already ACTIVE {{(pid=98213) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} May 27 21:02:54.221125 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Snapshot image upload complete May 27 21:02:54.221390 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-e373bad8-03e3-443f-92b4-781954283a63 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Took 5.63 seconds to snapshot the instance on the hypervisor. May 27 21:02:54.387524 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:02:54.390126 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:02:54.737309 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:54.894839 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Received event ua-d6a1fc42-6b17-46f6-b4f0-a605fb6da369> from libvirt while the driver is waiting for it; dispatched. {{(pid=98213) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} May 27 21:02:54.897086 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully detached device vdb from instance 698b750b-959f-4358-b7a0-5f68e76f5a4a from the live domain config. May 27 21:02:54.943172 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:02:54.943506 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:54.943665 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:54.944014 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:54.944341 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd6a1fc42-6b17-46f6-b4f0-a605fb6da369', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:02:54.944489 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:02:54.981778 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:54.981778 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:54.981778 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:54.981778 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:54.981778 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:54.981778 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:54.981778 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:54.981778 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:54.981778 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:54.981778 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:54.981778 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:54.982002 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:54.982002 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:54.982002 np0000001553 nova-compute[98213]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:54.982002 np0000001553 nova-compute[98213]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369 (non-flash) May 27 21:02:54.982002 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:54.982002 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:54.982002 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:54.982002 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:54.982002 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:54.982002 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:54.982002 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:54.982232 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:02:54.982232 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', '13')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:02:54.983199 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369', '14')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:02:54.984054 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Resulting device map defaultdict(. at 0x79ced03c3740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369'): ({'sdg'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:02:54.984294 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Removing multipathed devices sdf, sdg {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:02:54.984536 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flush multipath device 330000000c0633167 {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:02:55.013723 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:02:55.060577 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:02:55.081650 np0000001553 nova-compute[98213]: DEBUG nova.compute.rpcapi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98213) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} May 27 21:02:55.094468 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:55.094720 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:55.094720 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:55.102601 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:02:55.102732 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:02:55.104340 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:02:55.119043 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:02:55.119381 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:02:55.132777 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:55.171950 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369, portal: 192.168.40.100,3260] May 27 21:02:55.171950 np0000001553 nova-compute[98213]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369, portal: 192.168.40.100,3260] successful. May 27 21:02:55.171950 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:55.193701 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:55.207090 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:55.241171 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369, portal: 192.168.50.100,3260] May 27 21:02:55.241171 np0000001553 nova-compute[98213]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-d6a1fc42-6b17-46f6-b4f0-a605fb6da369, portal: 192.168.50.100,3260] successful. May 27 21:02:55.241171 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:55.262293 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:55.262293 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:55.262293 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== disconnect_volume: return (317ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:55.262293 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:02:55.838024 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'flavor' on Instance uuid 698b750b-959f-4358-b7a0-5f68e76f5a4a {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:55.847057 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Received event ua-5e75d999-c6d6-489b-8483-5f3a34c5b898> from libvirt while the driver is waiting for it; dispatched. {{(pid=98213) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} May 27 21:02:55.848198 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5e75d999-c6d6-489b-8483-5f3a34c5b898 for instance aac9c5e0-da16-44ef-b255-53b21d0cc63d {{(pid=98213) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} May 27 21:02:55.850613 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Successfully detached device vdb from instance aac9c5e0-da16-44ef-b255-53b21d0cc63d from the live domain config. May 27 21:02:55.902360 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:02:55.904641 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e75d999-c6d6-489b-8483-5f3a34c5b898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:55.904641 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:02:55.904641 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:02:55.904641 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5e75d999-c6d6-489b-8483-5f3a34c5b898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:02:55.904641 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:02:55.936701 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:55.936701 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:55.936701 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:55.936701 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:55.936701 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:55.936701 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:55.936701 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:55.936701 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:55.936701 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:02:55.936971 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:55.936971 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:02:55.936971 np0000001553 nova-compute[98213]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:55.936971 np0000001553 nova-compute[98213]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898 (non-flash) May 27 21:02:55.936971 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:55.936971 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:02:55.936971 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:55.936971 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:02:55.936971 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:02:55.936971 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:02:55.937504 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', '15')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:02:55.938085 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898', '16')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:02:55.939314 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Resulting device map defaultdict(. at 0x79ced02fbf60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898'): ({'sdm'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:02:55.939579 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Removing multipathed devices sdl, sdm {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:02:55.940591 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Flush multipath device 330000000da4990e6 {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:02:55.971232 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:02:56.020491 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:02:56.028582 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:56.028856 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:56.070013 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:02:56.070266 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:02:56.071802 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:02:56.083689 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:02:56.083880 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:02:56.096545 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:56.104032 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:56.144639 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898, portal: 192.168.40.100,3260] May 27 21:02:56.144639 np0000001553 nova-compute[98213]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898, portal: 192.168.40.100,3260] successful. May 27 21:02:56.144639 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:56.168304 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:56.182414 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:56.225273 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898, portal: 192.168.50.100,3260] May 27 21:02:56.225273 np0000001553 nova-compute[98213]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-5e75d999-c6d6-489b-8483-5f3a34c5b898, portal: 192.168.50.100,3260] successful. May 27 21:02:56.225273 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:56.249717 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:02:56.249717 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:02:56.249823 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] <== disconnect_volume: return (347ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:56.249915 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:02:56.265872 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9306fa3e-9ddf-4ac9-8f26-0ff466d957a0 req-73341c0b-7e3c-4234-a697-b0ddea87275f service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:56.268984 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9306fa3e-9ddf-4ac9-8f26-0ff466d957a0 req-73341c0b-7e3c-4234-a697-b0ddea87275f service nova] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:56.268984 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9306fa3e-9ddf-4ac9-8f26-0ff466d957a0 req-73341c0b-7e3c-4234-a697-b0ddea87275f service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:56.269135 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9306fa3e-9ddf-4ac9-8f26-0ff466d957a0 req-73341c0b-7e3c-4234-a697-b0ddea87275f service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:56.269323 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9306fa3e-9ddf-4ac9-8f26-0ff466d957a0 req-73341c0b-7e3c-4234-a697-b0ddea87275f service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] No waiting events found dispatching network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:56.269490 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-9306fa3e-9ddf-4ac9-8f26-0ff466d957a0 req-73341c0b-7e3c-4234-a697-b0ddea87275f service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received unexpected event network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c for instance with vm_state active and task_state resize_migrated. May 27 21:02:56.326129 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:02:56.326282 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquired lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:02:56.326505 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:02:56.531648 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:02:56.589678 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:56.716658 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:56.821297 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lazy-loading 'flavor' on Instance uuid aac9c5e0-da16-44ef-b255-53b21d0cc63d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:56.828838 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:56.850163 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5791ca12-1731-4061-aa0d-054c15f2b21e tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "698b750b-959f-4358-b7a0-5f68e76f5a4a" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 7.527s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:57.087260 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:57.088153 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:57.092639 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:02:57.092916 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Claim successful on node np0000001553 May 27 21:02:57.140604 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:02:57.277290 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating instance_info_cache with network_info: [{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:02:57.780697 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Releasing lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:02:57.828335 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b1097384-7bb0-41da-8b7e-ffe649e8d9cd tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.815s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:58.192952 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:58.291904 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:02:58.305706 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:02:58.337669 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:58.397005 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:58.397365 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:58.397624 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:58.397838 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:58.399662 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:02:58.406705 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:58.409010 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ed191392-a3e2-416e-9a49-1e44383b0689 req-f0af15d4-0929-4825-a159-60da3714dad1 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:02:58.409908 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:02:58.411266 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ed191392-a3e2-416e-9a49-1e44383b0689 req-f0af15d4-0929-4825-a159-60da3714dad1 service nova] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:58.411722 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ed191392-a3e2-416e-9a49-1e44383b0689 req-f0af15d4-0929-4825-a159-60da3714dad1 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:58.415970 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ed191392-a3e2-416e-9a49-1e44383b0689 req-f0af15d4-0929-4825-a159-60da3714dad1 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.004s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:58.416947 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Terminating instance May 27 21:02:58.419158 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ed191392-a3e2-416e-9a49-1e44383b0689 req-f0af15d4-0929-4825-a159-60da3714dad1 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] No waiting events found dispatching network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:02:58.419435 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-ed191392-a3e2-416e-9a49-1e44383b0689 req-f0af15d4-0929-4825-a159-60da3714dad1 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received unexpected event network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c for instance with vm_state active and task_state resize_finish. May 27 21:02:58.422616 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:02:58.424675 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fef9:239e', 'fe80::f4a8:7bff:feae:7ec3', 'fe80::fc16:3eff:fe2b:af36', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc', 'fe80::fc16:3eff:fe74:7207', 'fe80::fc16:3eff:fead:5cb7', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::b04a:b6ff:fe52:4741'] May 27 21:02:58.424781 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:02:58.424880 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:02:58.425078 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:02:58.500152 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:58.500152 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:58.500152 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:58.500152 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:58.500152 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:02:58.505039 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Terminating instance May 27 21:02:58.931222 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:02:58.955763 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:58.968472 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:58.982300 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.006773 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:02:59.006980 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:02:59.013386 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:02:59.042682 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.048003 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.067226 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.109792 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:02:59.109962 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:02:59.173483 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.183331 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.208552 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.241060 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.348883 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.363562 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.378529 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.407986 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.99967513799993 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:59.413814 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Instance destroyed successfully. May 27 21:02:59.417177 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lazy-loading 'resources' on Instance uuid aac9c5e0-da16-44ef-b255-53b21d0cc63d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:59.417177 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.422656 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.429486 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999661364000076 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:02:59.437203 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Instance destroyed successfully. May 27 21:02:59.437650 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lazy-loading 'resources' on Instance uuid d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:02:59.441779 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.512536 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:02:59.597604 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Starting finish_migration {{(pid=98213) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}} May 27 21:02:59.599642 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance directory exists: not creating {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} May 27 21:02:59.599757 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Creating image(s) May 27 21:02:59.600589 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:59.614326 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:02:59.689699 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.089s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:59.690181 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:02:59.691085 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:02:59.785790 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:02:59.786493 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Cannot resize image /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:02:59.790089 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.799946 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.828187 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.838154 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.919992 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1213684862-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-testmultiattachvolumeswap-server-1213684862-1',id=7,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfwKtizXaBz0MCTR1m5iV2opJ4gC7KfX1+235hm6r98nGePvaTPwaDqdHeiTLJ2PSdeYNmntcKtj5xT0l5WOyP88QlDWXCp5+kw9VixVKS7+BRbRQsaKBG5YMLdB3bveg==',key_name='tempest-keypair-1015459028',keypairs=,launch_index=0,launched_at=2026-05-27T21:01:42Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='3b0d658b24414d8aadb0cb04849300a3',ramdisk_id='',reservation_id='r-i83qhj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-28626955',owner_user_name='tempest-TestMultiAttachVolumeSwap-28626955-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:01:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ef4507fea674555a32ee8d5a982e7d6',uuid=aac9c5e0-da16-44ef-b255-53b21d0cc63d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:02:59.920629 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converting VIF {"id": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "address": "fa:16:3e:f9:23:9e", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a0341-d7", "ovs_interfaceid": "d60a0341-d711-4a9b-83bb-cad3bf479f30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:59.921666 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=d60a0341-d711-4a9b-83bb-cad3bf479f30,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a0341-d7') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:59.921666 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=d60a0341-d711-4a9b-83bb-cad3bf479f30,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a0341-d7') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:02:59.925382 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.925382 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd60a0341-d7, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:59.925986 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.927576 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:59.933885 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.935696 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.936043 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d28c393-8467-4f3b-84c6-943a730cde80) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:59.937830 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.939503 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:59.944781 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1213684862-2',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-testmultiattachvolumeswap-server-1213684862-2',id=8,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfwKtizXaBz0MCTR1m5iV2opJ4gC7KfX1+235hm6r98nGePvaTPwaDqdHeiTLJ2PSdeYNmntcKtj5xT0l5WOyP88QlDWXCp5+kw9VixVKS7+BRbRQsaKBG5YMLdB3bveg==',key_name='tempest-keypair-1015459028',keypairs=,launch_index=1,launched_at=2026-05-27T21:01:37Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='3b0d658b24414d8aadb0cb04849300a3',ramdisk_id='',reservation_id='r-i83qhj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-28626955',owner_user_name='tempest-TestMultiAttachVolumeSwap-28626955-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:01:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ef4507fea674555a32ee8d5a982e7d6',uuid=d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:02:59.944781 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converting VIF {"id": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "address": "fa:16:3e:2b:af:36", "network": {"id": "386e3ec3-c25b-4699-b451-f05ccb441f8b", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-209070395-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3b0d658b24414d8aadb0cb04849300a3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22d5bf5-4e", "ovs_interfaceid": "f22d5bf5-4ec9-44c2-956b-553ed90ce5c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:02:59.944781 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:af:36,bridge_name='br-int',has_traffic_filtering=True,id=f22d5bf5-4ec9-44c2-956b-553ed90ce5c4,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22d5bf5-4e') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:02:59.945095 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:af:36,bridge_name='br-int',has_traffic_filtering=True,id=f22d5bf5-4ec9-44c2-956b-553ed90ce5c4,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22d5bf5-4e') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:02:59.947849 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.948006 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.948559 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf22d5bf5-4e, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:59.950197 np0000001553 nova-compute[98213]: INFO os_vif [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:23:9e,bridge_name='br-int',has_traffic_filtering=True,id=d60a0341-d711-4a9b-83bb-cad3bf479f30,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a0341-d7') May 27 21:02:59.950521 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.951765 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Deleting instance files /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d_del May 27 21:02:59.953364 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:59.954570 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.954570 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f88b7521-8478-4a7e-831e-c4354eb5faaf) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:02:59.955573 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Deletion of /opt/stack/data/nova/instances/aac9c5e0-da16-44ef-b255-53b21d0cc63d_del complete May 27 21:02:59.957929 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.958882 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:02:59.960949 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:02:59.968481 np0000001553 nova-compute[98213]: INFO os_vif [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:af:36,bridge_name='br-int',has_traffic_filtering=True,id=f22d5bf5-4ec9-44c2-956b-553ed90ce5c4,network=Network(386e3ec3-c25b-4699-b451-f05ccb441f8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22d5bf5-4e') May 27 21:02:59.968481 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Deleting instance files /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d_del May 27 21:02:59.968931 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Deletion of /opt/stack/data/nova/instances/d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d_del complete May 27 21:02:59.988679 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:00.029294 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.941s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:00.030155 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:03:00.203725 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:00.204292 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:00.208638 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:03:00.208950 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Claim successful on node np0000001553 May 27 21:03:00.292936 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Did not create local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} May 27 21:03:00.292936 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Ensure instance console log exists: /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:03:00.292936 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:00.292936 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:00.292936 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:00.295598 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Start _get_guest_xml network_info=[{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2030006956-network", "vif_mac": "fa:16:3e:83:3a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '950bfe97-53fd-4086-bfa5-69ea3a75c088', 'attached_at': '2026-05-27T21:02:59.000000', 'detached_at': '', 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'serial': '23f1203c-2f1d-487c-8874-bb9efa65e764'}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'e8a70e03-914d-4e93-a09c-fb8cd41bd692', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:03:00.297065 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:03:00.298166 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-636487866', uuid='950bfe97-53fd-4086-bfa5-69ea3a75c088'), owner=OwnerMeta(userid='606bde5cb68847cc8b7b2af092fc6bd6', username='tempest-ServerActionsTestOtherB-1747713240-project-member', projectid='3811fd8e033640e18a7080fe0a65d975', projectname='tempest-ServerActionsTestOtherB-1747713240'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2030006956-network", "vif_mac": "fa:16:3e:83:3a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915780.2977242) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:03:00.300564 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:03:00.300877 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:03:00.301486 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:03:00.301654 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:03:00.302805 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:03:00.302980 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:03:00.303122 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:03:00.303122 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:03:00.303684 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:03:00.303684 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:03:00.303684 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:03:00.303684 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:03:00.303684 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:03:00.303684 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:03:00.304295 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:03:00.304295 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:03:00.313553 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.config --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:00.336242 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:00.395165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.config --force-share --output=json" returned: 0 in 0.080s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:00.395165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "/opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:00.395165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "/opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:00.395165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "/opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:00.395165 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:03:00.395543 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:00.395543 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:00.399292 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:00.399292 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:03:00.412163 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:00.412163 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:00.412163 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:00.412163 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:00.412163 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:00.412163 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:00.424881 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:00.424881 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:00.429358 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:00.429358 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:00.436007 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764] added May 27 21:03:00.436007 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:00.436007 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:00.436007 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:00.436007 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:00.436007 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:00.436007 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:00.436219 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:00.436366 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0255(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:00.436498 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:00.444576 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764] added May 27 21:03:00.444576 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:00.444576 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:00.444576 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:00.444576 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:00.444576 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:00.444576 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:00.445301 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:00.445301 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:00.445301 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:00.464250 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Took 1.53 seconds to destroy the instance on the hypervisor. May 27 21:03:00.465995 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:03:00.465995 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:03:00.465995 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:03:00.467520 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:00.478010 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Took 1.46 seconds to destroy the instance on the hypervisor. May 27 21:03:00.478010 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:03:00.478010 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:03:00.478010 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:03:00.478010 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:00.537492 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:03:00.537604 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:03:00.537789 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:00.537964 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:00.543783 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:00.617372 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:00.627426 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18e30c231082464ab556592986d8b793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fe4bede0c741bfb93a23985eeef42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:03:00.993339 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-073bef56-5d39-4292-b265-d034981cef52 req-e815677e-d141-45c3-b404-18d0b13b5eec service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Received event network-vif-deleted-f22d5bf5-4ec9-44c2-956b-553ed90ce5c4 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:00.993466 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-073bef56-5d39-4292-b265-d034981cef52 req-e815677e-d141-45c3-b404-18d0b13b5eec service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Neutron deleted interface f22d5bf5-4ec9-44c2-956b-553ed90ce5c4; detaching it from the instance and deleting it from the info cache May 27 21:03:00.997158 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-073bef56-5d39-4292-b265-d034981cef52 req-e815677e-d141-45c3-b404-18d0b13b5eec service nova] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Detach interface failed, port_id=f22d5bf5-4ec9-44c2-956b-553ed90ce5c4, reason: Instance d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:03:01.045842 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:03:01.049209 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-f194a80d-c2bc-4e82-8610-8ac9bad11e02 req-1427ca87-d670-45a7-94cc-401c21db4912 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Received event network-vif-deleted-d60a0341-d711-4a9b-83bb-cad3bf479f30 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:01.049480 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-f194a80d-c2bc-4e82-8610-8ac9bad11e02 req-1427ca87-d670-45a7-94cc-401c21db4912 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Neutron deleted interface d60a0341-d711-4a9b-83bb-cad3bf479f30; detaching it from the instance and deleting it from the info cache May 27 21:03:01.051404 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-f194a80d-c2bc-4e82-8610-8ac9bad11e02 req-1427ca87-d670-45a7-94cc-401c21db4912 service nova] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Detach interface failed, port_id=d60a0341-d711-4a9b-83bb-cad3bf479f30, reason: Instance aac9c5e0-da16-44ef-b255-53b21d0cc63d could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:03:01.425439 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:01.437523 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:01.445931 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:01.461064 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:01.461064 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:01.461064 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:01.466960 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:01.466960 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:01.466960 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:01.466960 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:01.480884 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:01.485455 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:01.490386 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:01.498829 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Successfully created port: ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:03:01.502888 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.502888 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.502888 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.502888 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.502888 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.502888 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.502888 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:01.503279 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.503279 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.503279 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.503279 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.503279 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.503279 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.503279 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:01.514953 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.514953 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.514953 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.514953 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.514953 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.514953 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.514953 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:01.515353 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.515353 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.515353 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.515353 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.515353 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.515353 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.515353 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:01.542277 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] May 27 21:03:01.542277 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] successful. May 27 21:03:01.542277 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:01.558024 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:03:01.564728 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:01.573212 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] May 27 21:03:01.573212 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] successful. May 27 21:03:01.573212 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:01.589779 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:01.591084 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.591084 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.591084 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:01.591084 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:01.591084 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.591084 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.591084 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.591084 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.591084 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:01.592506 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.592506 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.592506 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:01.592506 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:01.592506 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.592506 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.592506 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.592506 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.592506 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:01.592820 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:01.592902 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:01.597194 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] HCTL ('11', '-', '-', 0) found on session 19 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:01.597194 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:01.612596 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.612596 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.612596 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:01.612596 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:01.612596 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.612596 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.612596 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.612596 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.612596 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:01.613231 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.613231 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:01.613231 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:01.613231 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:01.613231 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.613231 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:01.613231 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.613231 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:01.613231 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:01.613231 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:01.614433 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:01.615461 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] HCTL ('12', '-', '-', 0) found on session 20 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:01.615601 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:01.634926 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching for a device in session 19 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:01.636704 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:01.643133 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching for a device in session 20 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:01.643133 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:01.722407 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:01.931956 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Took 1.45 seconds to deallocate network for instance. May 27 21:03:01.991733 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Took 1.53 seconds to deallocate network for instance. May 27 21:03:02.067847 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Booting with volume-backed-image 58b1bbfa-5e93-4445-8446-fffa20b98b42 at /dev/vda May 27 21:03:02.223855 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Successfully updated port: ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:03:02.226407 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:02.226676 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:02.411048 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:03:02.425895 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:02.445022 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:02.501300 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:02.727489 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:02.727721 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquired lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:02.727803 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:03:02.738200 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:03.071348 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d8965a44-bcaf-4c90-8602-646412dd1071 req-08179520-5064-48b2-b785-57215fd03b41 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-changed-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:03.072554 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d8965a44-bcaf-4c90-8602-646412dd1071 req-08179520-5064-48b2-b785-57215fd03b41 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Refreshing instance network info cache due to event network-changed-ef5211c5-95b3-4091-804e-3e3da3b14d0b. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:03.072702 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d8965a44-bcaf-4c90-8602-646412dd1071 req-08179520-5064-48b2-b785-57215fd03b41 service nova] Acquiring lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:03.242235 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.038s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:03.242897 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.797s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:03.243225 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:03:03.331014 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:03:03.429080 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Found WWN 330000000c5130650 for multipath device dm-4 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:03:03.429593 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:03.429593 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000c5130650', 'path': '/dev/dm-4', 'multipath_id': '330000000c5130650'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:03.429663 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c5130650', 'path': '/dev/dm-4', 'multipath_id': '330000000c5130650'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:03:03.522116 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:03.698585 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Updating instance_info_cache with network_info: [{"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:03.749251 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:03:03.750696 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:03:03.750802 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:03.751063 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:03.843534 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac9557e825354813ac31afa70f07ffc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251237411f6e4bb49303c88852d6e9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:03:03.938716 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-636487866',display_name='tempest-ServerActionsTestOtherB-server-636487866',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000001553',hostname='tempest-serveractionstestotherb-server-636487866',id=9,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP37vEU7tk6IZLG6nGgYJrRWC1XysqG9qhj9f6Ts3gEcgfRgE2Kuebb5geAJYt0lQJDqjDBxoFON2pCBOOFgVRPjkb/YhHT2yjUMuBmc0jN1WzS2xreRxA0w+OzMqxnUwQ==',key_name='tempest-keypair-736936884',keypairs=,launch_index=0,launched_at=2026-05-27T21:01:49Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001553',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3811fd8e033640e18a7080fe0a65d975',ramdisk_id='',reservation_id='r-004tqvtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1747713240',owner_user_name='tempest-ServerActionsTestOtherB-1747713240-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='606bde5cb68847cc8b7b2af092fc6bd6',uuid=950bfe97-53fd-4086-bfa5-69ea3a75c088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2030006956-network", "vif_mac": "fa:16:3e:83:3a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:03:03.938972 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converting VIF {"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2030006956-network", "vif_mac": "fa:16:3e:83:3a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:03.939835 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:03.942404 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] End _get_guest_xml xml= May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 950bfe97-53fd-4086-bfa5-69ea3a75c088 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: instance-00000009 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 262144 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 1 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherB-server-636487866 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 2026-05-27 21:03:00 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 256 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 1 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 0 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 0 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 1 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: True May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: bare May 27 21:03:03.942404 np0000001553 nova-compute[98213]: qcow2 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 1 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 0 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: ide May 27 21:03:03.942404 np0000001553 nova-compute[98213]: virtio May 27 21:03:03.942404 np0000001553 nova-compute[98213]: pc May 27 21:03:03.942404 np0000001553 nova-compute[98213]: virtio May 27 21:03:03.942404 np0000001553 nova-compute[98213]: virtio May 27 21:03:03.942404 np0000001553 nova-compute[98213]: virtio May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherB-1747713240-project-member May 27 21:03:03.942404 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherB-1747713240 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:03:03.942404 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 950bfe97-53fd-4086-bfa5-69ea3a75c088 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 950bfe97-53fd-4086-bfa5-69ea3a75c088 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: hvm May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 128 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 1 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: Nehalem May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: 23f1203c-2f1d-487c-8874-bb9efa65e764 May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: May 27 21:03:03.942404 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:03:03.945323 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-636487866',display_name='tempest-ServerActionsTestOtherB-server-636487866',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000001553',hostname='tempest-serveractionstestotherb-server-636487866',id=9,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP37vEU7tk6IZLG6nGgYJrRWC1XysqG9qhj9f6Ts3gEcgfRgE2Kuebb5geAJYt0lQJDqjDBxoFON2pCBOOFgVRPjkb/YhHT2yjUMuBmc0jN1WzS2xreRxA0w+OzMqxnUwQ==',key_name='tempest-keypair-736936884',keypairs=,launch_index=0,launched_at=2026-05-27T21:01:49Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001553',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3811fd8e033640e18a7080fe0a65d975',ramdisk_id='',reservation_id='r-004tqvtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1747713240',owner_user_name='tempest-ServerActionsTestOtherB-1747713240-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='606bde5cb68847cc8b7b2af092fc6bd6',uuid=950bfe97-53fd-4086-bfa5-69ea3a75c088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2030006956-network", "vif_mac": "fa:16:3e:83:3a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:03:03.945323 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converting VIF {"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2030006956-network", "vif_mac": "fa:16:3e:83:3a:d3"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:03.945530 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:03.945530 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:03:03.945530 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:03.945530 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:03.945685 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:03:03.949503 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:03.949688 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba92b8c4-16bc-5bb1-91f6-86d37a709949', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:03.950554 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:03.951368 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:03.955311 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:03.957866 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:03.958035 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c501903-cc, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:03.958412 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c501903-cc, col_values=(('qos', UUID('630f75b4-b184-4a5b-b05a-7dff76b30380')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:03.958496 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c501903-cc, col_values=(('external_ids', {'iface-id': '8c501903-cc36-46d4-9ca9-87394e07d00c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:3a:d3', 'vm-uuid': '950bfe97-53fd-4086-bfa5-69ea3a75c088'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:03.959838 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:03.961245 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:03.967007 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:03.967972 np0000001553 nova-compute[98213]: INFO os_vif [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') May 27 21:03:04.127165 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:04.127525 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:04.200504 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Releasing lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:04.200767 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Instance network_info: |[{"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:03:04.201527 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d8965a44-bcaf-4c90-8602-646412dd1071 req-08179520-5064-48b2-b785-57215fd03b41 service nova] Acquired lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:04.201677 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-d8965a44-bcaf-4c90-8602-646412dd1071 req-08179520-5064-48b2-b785-57215fd03b41 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Refreshing network info cache for port ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:04.251607 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:03:04.405502 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:04.523446 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Successfully created port: bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:03:04.630575 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:04.710794 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-d8965a44-bcaf-4c90-8602-646412dd1071 req-08179520-5064-48b2-b785-57215fd03b41 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:04.754080 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:03:05.072657 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-d8965a44-bcaf-4c90-8602-646412dd1071 req-08179520-5064-48b2-b785-57215fd03b41 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:05.077431 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Successfully updated port: bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:03:05.128759 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-3a9d7093-760e-4262-afe4-f96f2a376050 req-e5bd59af-ae60-4402-830d-b9f2a99f6927 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-changed-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:05.129202 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-3a9d7093-760e-4262-afe4-f96f2a376050 req-e5bd59af-ae60-4402-830d-b9f2a99f6927 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Refreshing instance network info cache due to event network-changed-bbe00ed4-45d2-4b31-a1c0-aadcf463da83. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:05.129310 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3a9d7093-760e-4262-afe4-f96f2a376050 req-e5bd59af-ae60-4402-830d-b9f2a99f6927 service nova] Acquiring lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:05.129425 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3a9d7093-760e-4262-afe4-f96f2a376050 req-e5bd59af-ae60-4402-830d-b9f2a99f6927 service nova] Acquired lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:05.129537 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-3a9d7093-760e-4262-afe4-f96f2a376050 req-e5bd59af-ae60-4402-830d-b9f2a99f6927 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Refreshing network info cache for port bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:05.139811 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.897s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:05.142389 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.638s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:05.246487 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Deleted allocations for instance d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d May 27 21:03:05.269791 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-d8965a44-bcaf-4c90-8602-646412dd1071 req-08179520-5064-48b2-b785-57215fd03b41 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Updated VIF entry in instance network info cache for port ef5211c5-95b3-4091-804e-3e3da3b14d0b. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:03:05.269791 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-d8965a44-bcaf-4c90-8602-646412dd1071 req-08179520-5064-48b2-b785-57215fd03b41 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Updating instance_info_cache with network_info: [{"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:05.484684 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:05.485227 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:05.485227 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:05.485365 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] No VIF found with MAC fa:16:3e:83:3a:d3, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:05.486185 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Using config drive May 27 21:03:05.579708 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:05.634050 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-3a9d7093-760e-4262-afe4-f96f2a376050 req-e5bd59af-ae60-4402-830d-b9f2a99f6927 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:05.738671 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-3a9d7093-760e-4262-afe4-f96f2a376050 req-e5bd59af-ae60-4402-830d-b9f2a99f6927 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:03:05.766178 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:03:05.767227 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:03:05.768089 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Creating image(s) May 27 21:03:05.770491 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "/opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:05.770806 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "/opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:05.771412 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d8965a44-bcaf-4c90-8602-646412dd1071 req-08179520-5064-48b2-b785-57215fd03b41 service nova] Releasing lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:05.772034 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "/opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:05.777187 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:05.782354 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:05.786205 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:05.874483 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.089s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:05.874835 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:05.875245 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:05.875703 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:05.878838 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:05.879260 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:05.912517 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0036037029999533843 future=) was cancelled during its delay period, skipping {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:05.914359 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:05.914580 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.6586404629999834 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:05.914635 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.6585308109999914 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:05.915769 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:05.930022 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:03:05.949573 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-3a9d7093-760e-4262-afe4-f96f2a376050 req-e5bd59af-ae60-4402-830d-b9f2a99f6927 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:05.957317 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:05.974061 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:05.975191 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:05.987856 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:05.995795 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:03:06.000886 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:03:06.011026 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:03:06.018683 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:06.018683 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc', 'fe80::fc16:3eff:fe74:7207', 'fe80::fc16:3eff:fead:5cb7', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::b04a:b6ff:fe52:4741', 'fe80::fc16:3eff:fe83:3ad3'] May 27 21:03:06.018683 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:03:06.018683 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:03:06.018683 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:06.019005 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Updating existing volume attachment record: 430b7db0-16f2-41fc-8a7d-15354f1dec4b {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:03:06.048567 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk 1073741824" returned: 0 in 0.073s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:06.049017 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.174s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:06.049120 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:06.113234 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:06.147617 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:06.147894 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:06.155803 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.106s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:06.156872 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:03:06.157038 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:06.266789 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:06.267592 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Cannot resize image /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:03:06.267705 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:03:06.267873 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Ensure instance console log exists: /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:03:06.268436 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:06.268638 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:06.268777 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:06.269771 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-06485c9e-a8e1-4813-af66-3b0fd6fc425b tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.770s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:06.299257 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-16901e74-003f-46d2-b697-2c411b017548 req-a440e98a-9f9d-4ab9-8f3d-56945d19cd05 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:06.301278 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-16901e74-003f-46d2-b697-2c411b017548 req-a440e98a-9f9d-4ab9-8f3d-56945d19cd05 service nova] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:06.301781 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-16901e74-003f-46d2-b697-2c411b017548 req-a440e98a-9f9d-4ab9-8f3d-56945d19cd05 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:06.301781 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-16901e74-003f-46d2-b697-2c411b017548 req-a440e98a-9f9d-4ab9-8f3d-56945d19cd05 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:06.301965 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-16901e74-003f-46d2-b697-2c411b017548 req-a440e98a-9f9d-4ab9-8f3d-56945d19cd05 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] No waiting events found dispatching network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:06.302016 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-16901e74-003f-46d2-b697-2c411b017548 req-a440e98a-9f9d-4ab9-8f3d-56945d19cd05 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received unexpected event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c for instance with vm_state active and task_state resize_finish. May 27 21:03:06.392562 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:06.400271 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:06.420250 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:06.432470 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6b9e41b2-e5d0-41e2-8087-22da8f65a999 req-4cd740ff-7173-4abc-9df8-65841a32b411 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:06.432651 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b9e41b2-e5d0-41e2-8087-22da8f65a999 req-4cd740ff-7173-4abc-9df8-65841a32b411 service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:06.432817 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b9e41b2-e5d0-41e2-8087-22da8f65a999 req-4cd740ff-7173-4abc-9df8-65841a32b411 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:06.432947 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6b9e41b2-e5d0-41e2-8087-22da8f65a999 req-4cd740ff-7173-4abc-9df8-65841a32b411 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:06.433078 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6b9e41b2-e5d0-41e2-8087-22da8f65a999 req-4cd740ff-7173-4abc-9df8-65841a32b411 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:06.433232 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-6b9e41b2-e5d0-41e2-8087-22da8f65a999 req-4cd740ff-7173-4abc-9df8-65841a32b411 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received unexpected event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with vm_state building and task_state block_device_mapping. May 27 21:03:06.452925 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3a9d7093-760e-4262-afe4-f96f2a376050 req-e5bd59af-ae60-4402-830d-b9f2a99f6927 service nova] Releasing lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:06.453474 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquired lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:06.453671 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:03:06.573606 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00040277499988405907 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:06.574315 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:06.574563 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Stopped (Lifecycle Event) May 27 21:03:06.576543 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:06.577543 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.830747114999895 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:06.577543 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.830625729999838 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:06.653228 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:06.728494 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:06.884362 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for 950bfe97-53fd-4086-bfa5-69ea3a75c088 due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:03:06.884511 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:06.884617 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Resumed (Lifecycle Event) May 27 21:03:06.887382 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance event wait completed in 0 seconds for {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:03:06.891252 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance running successfully. May 27 21:03:06.892382 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Failed to set time: agent not configured {{(pid=98213) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} May 27 21:03:06.892527 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-078158a2-a223-409b-9d25-b4abb4ce7ed7 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] finish_migration finished successfully. {{(pid=98213) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}} May 27 21:03:07.027863 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:03:07.080876 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:07.094993 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:07.163082 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.024s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:07.217311 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:07.236477 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Deleted allocations for instance aac9c5e0-da16-44ef-b255-53b21d0cc63d May 27 21:03:07.387925 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:07.389574 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:07.400771 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updating instance_info_cache with network_info: [{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:07.892414 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] During sync_power_state the instance has a pending task (resize_finish). Skip. May 27 21:03:07.892891 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:07.892891 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Started (Lifecycle Event) May 27 21:03:07.906684 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Releasing lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:07.907051 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Instance network_info: |[{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:03:07.909762 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Start _get_guest_xml network_info=[{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:03:07.912011 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:03:07.913607 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='59971b35-cbb8-420e-a34e-b614819ad555'), owner=OwnerMeta(userid='ac9557e825354813ac31afa70f07ffc7', username='tempest-AttachVolumeMultiAttachTest-1088868426-project-member', projectid='251237411f6e4bb49303c88852d6e9a1', projectname='tempest-AttachVolumeMultiAttachTest-1088868426'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915787.913135) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:03:07.914669 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:03:07.915078 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:03:07.915992 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:03:07.916495 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:03:07.917389 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:03:07.917790 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:03:07.917967 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:03:07.918081 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:03:07.918281 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:03:07.918369 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:03:07.918486 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:03:07.919352 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:03:07.919963 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:03:07.920188 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:03:07.920369 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:03:07.920606 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:03:07.936855 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='multiattach-server-0',id=16,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-arsqtjru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=59971b35-cbb8-420e-a34e-b614819ad555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:03:07.937060 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:07.938050 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:07.938734 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'pci_devices' on Instance uuid 59971b35-cbb8-420e-a34e-b614819ad555 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:08.158810 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:03:08.159830 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:03:08.160083 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Creating image(s) May 27 21:03:08.160396 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Did not create local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} May 27 21:03:08.160480 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Ensure instance console log exists: /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:03:08.160709 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:08.160846 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:08.160989 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:08.161659 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Start _get_guest_xml network_info=[{"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9992b23e-7582-49b6-977c-45dfc6f43ea3', 'attached_at': '', 'detached_at': '', 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'serial': '72582c17-9811-4887-aaf7-fa2d1fa07bda'}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '430b7db0-16f2-41fc-8a7d-15354f1dec4b', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:03:08.163918 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:03:08.164864 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-505213430', uuid='9992b23e-7582-49b6-977c-45dfc6f43ea3'), owner=OwnerMeta(userid='18e30c231082464ab556592986d8b793', username='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member', projectid='79fe4bede0c741bfb93a23985eeef42e', projectname='tempest-ServerBootFromVolumeStableRescueTest-1106755838'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915788.1646023) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:03:08.166049 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:03:08.166387 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:03:08.167717 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:03:08.167839 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:03:08.168716 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:03:08.169018 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:03:08.169342 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:03:08.169342 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:03:08.169497 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:03:08.169631 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:03:08.169746 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:03:08.169911 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:03:08.170026 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:03:08.170132 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:03:08.170284 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:03:08.170476 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:03:08.190725 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:03:08.191116 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:08.191262 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:08.191687 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:08.191954 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:03:08.207682 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:08.208636 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:08.209326 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:08.209526 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:08.210051 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:08.210413 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:08.221919 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:08.221919 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:08.227801 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:08.227801 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:08.232421 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda] added May 27 21:03:08.232421 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:08.232421 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:08.232421 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:08.232421 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:08.232421 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:08.232421 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:08.232723 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:08.233079 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:08.233393 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:08.241159 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda] added May 27 21:03:08.241159 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:08.241159 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:08.241159 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:08.241159 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:08.241159 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:08.241159 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:08.241534 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:08.241534 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:08.241534 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:08.245014 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d9270a7f-786b-4be1-b70d-ef6c9940fdbe tempest-TestMultiAttachVolumeSwap-28626955 tempest-TestMultiAttachVolumeSwap-28626955-project-member] Lock "aac9c5e0-da16-44ef-b255-53b21d0cc63d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.848s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:08.368627 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-63e66a5c-0222-4b90-b231-25504179ea41 req-8b88ffd3-a968-4054-b047-12d84fffafea service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:08.369099 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-63e66a5c-0222-4b90-b231-25504179ea41 req-8b88ffd3-a968-4054-b047-12d84fffafea service nova] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:08.369335 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-63e66a5c-0222-4b90-b231-25504179ea41 req-8b88ffd3-a968-4054-b047-12d84fffafea service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:08.369482 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-63e66a5c-0222-4b90-b231-25504179ea41 req-8b88ffd3-a968-4054-b047-12d84fffafea service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:08.369659 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-63e66a5c-0222-4b90-b231-25504179ea41 req-8b88ffd3-a968-4054-b047-12d84fffafea service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] No waiting events found dispatching network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:08.369823 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-63e66a5c-0222-4b90-b231-25504179ea41 req-8b88ffd3-a968-4054-b047-12d84fffafea service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received unexpected event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c for instance with vm_state resized and task_state resize_reverting. May 27 21:03:08.395589 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:08.396576 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:08.442912 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] End _get_guest_xml xml= May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 59971b35-cbb8-420e-a34e-b614819ad555 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: instance-00000010 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 196608 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 1 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: multiattach-server-0 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 2026-05-27 21:03:07 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 192 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 1 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 0 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 0 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 1 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: True May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: bare May 27 21:03:08.442912 np0000001553 nova-compute[98213]: qcow2 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 1 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 0 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: virtio May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426-project-member May 27 21:03:08.442912 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:03:08.442912 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 59971b35-cbb8-420e-a34e-b614819ad555 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 59971b35-cbb8-420e-a34e-b614819ad555 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: hvm May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 128 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: 1 May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: Nehalem May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: May 27 21:03:08.442912 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:03:08.442912 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Preparing to wait for external event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:03:08.442912 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:08.442912 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:08.447278 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:08.447278 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='multiattach-server-0',id=16,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-arsqtjru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=59971b35-cbb8-420e-a34e-b614819ad555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:03:08.447278 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:08.447456 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:08.447456 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:03:08.447456 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:08.447456 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:08.447456 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:03:08.448725 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:08.448725 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b7cb160-7cef-5b31-8896-17c1c40d343e', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:08.451258 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:08.451258 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:08.455398 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:08.455398 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbe00ed4-45, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:08.455398 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbe00ed4-45, col_values=(('qos', UUID('6bef0937-93b9-4f40-8198-f9d44d731064')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:08.455398 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbe00ed4-45, col_values=(('external_ids', {'iface-id': 'bbe00ed4-45d2-4b31-a1c0-aadcf463da83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:2a:d4', 'vm-uuid': '59971b35-cbb8-420e-a34e-b614819ad555'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:08.455398 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:08.456908 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:08.461781 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:08.462783 np0000001553 nova-compute[98213]: INFO os_vif [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') May 27 21:03:08.574012 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:08.683406 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:08.683627 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:08.683852 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:08.759024 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Port 8c501903-cc36-46d4-9ca9-87394e07d00c binding to destination host np0000001553 is already ACTIVE {{(pid=98213) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} May 27 21:03:08.759024 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:08.759160 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquired lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:08.759191 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:03:08.899312 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] During sync_power_state the instance has a pending task (resize_reverting). Skip. May 27 21:03:09.233606 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:09.242260 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:09.249354 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:09.249354 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:09.249354 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:09.261268 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:09.261268 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:09.261268 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:09.261268 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:09.261268 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:09.265994 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:09.275190 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:09.286652 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.286652 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.286652 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.286652 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.286652 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.286652 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.286652 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.286652 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.286652 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:09.287201 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.287201 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.287201 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.287201 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.287201 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.287201 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.287201 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.287201 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.287201 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:09.297495 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.297495 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.297495 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.297495 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.297495 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.297495 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.297495 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.297495 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.297495 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:09.297831 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.297831 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.297831 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.297831 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.297831 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.297831 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.297831 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.297831 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.297831 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:09.334750 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda, portal: 192.168.40.100,3260] May 27 21:03:09.334750 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda, portal: 192.168.40.100,3260] successful. May 27 21:03:09.334750 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:09.349198 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda, portal: 192.168.50.100,3260] May 27 21:03:09.349198 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda, portal: 192.168.50.100,3260] successful. May 27 21:03:09.349198 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:09.354638 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:09.363567 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:09.379492 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.379492 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.379492 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.379492 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.379492 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:09.379492 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:09.379492 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.379492 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.379492 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.379492 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.379492 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:09.379776 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.379776 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.379776 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.379776 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.379776 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:09.379776 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:09.379776 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.379776 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.379776 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.379776 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.379776 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:09.379992 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:09.379992 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:09.380750 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.380750 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.380750 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.380750 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.380750 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:09.380750 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:09.380750 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.380750 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.380750 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.380750 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.380750 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:09.380969 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.380969 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:09.380969 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.380969 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:09.380969 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:09.380969 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:09.380969 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.380969 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:09.380969 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.380969 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:09.380969 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:09.381264 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:09.381406 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:09.383624 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] HCTL ('14', '-', '-', 0) found on session 22 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:09.383884 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:09.384441 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] HCTL ('13', '-', '-', 0) found on session 21 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:09.384539 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:09.410985 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching for a device in session 21 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:09.410985 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:09.410985 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching for a device in session 22 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:09.410985 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:09.740239 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:09.889186 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating instance_info_cache with network_info: [{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:09.989206 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:09.989563 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:09.989563 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No VIF found with MAC fa:16:3e:62:2a:d4, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:09.989848 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Using config drive May 27 21:03:10.210025 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:03:10.343712 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:10.344109 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:10.391102 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Releasing lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:10.499934 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:10.632384 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Creating config drive at /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.config May 27 21:03:10.636302 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3qhl7grw {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:10.679170 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3qhl7grw" returned: 0 in 0.043s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:10.848132 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lazy-loading 'flavor' on Instance uuid a8b6e8af-99d6-4ab7-82c7-68af9f22c24f {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:10.895161 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Creating tmpfile /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/tmp77en4ytt to verify with other compute node that the instance is on the same shared storage. {{(pid=98213) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}} May 27 21:03:10.895609 np0000001553 nova-compute[98213]: DEBUG nova.compute.rpcapi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98213) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} May 27 21:03:11.137182 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:11.164933 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:11.227716 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Found WWN 330000000a02ec7e6 for multipath device dm-5 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:03:11.228643 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:11.231480 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000a02ec7e6', 'path': '/dev/dm-5', 'multipath_id': '330000000a02ec7e6'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:11.231480 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a02ec7e6', 'path': '/dev/dm-5', 'multipath_id': '330000000a02ec7e6'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:03:11.239856 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:11.345843 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:11.351558 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:11.388331 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5c9b0ad4-5f8c-4039-8689-8a24c9b34b16 req-cd2ef7bb-affd-4ccf-81f3-566b5285b383 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:11.389415 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5c9b0ad4-5f8c-4039-8689-8a24c9b34b16 req-cd2ef7bb-affd-4ccf-81f3-566b5285b383 service nova] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:11.389627 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5c9b0ad4-5f8c-4039-8689-8a24c9b34b16 req-cd2ef7bb-affd-4ccf-81f3-566b5285b383 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:11.389763 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5c9b0ad4-5f8c-4039-8689-8a24c9b34b16 req-cd2ef7bb-affd-4ccf-81f3-566b5285b383 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:11.389897 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5c9b0ad4-5f8c-4039-8689-8a24c9b34b16 req-cd2ef7bb-affd-4ccf-81f3-566b5285b383 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Processing event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:03:11.426464 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:11.445547 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:11.455932 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:11.485784 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:11.736060 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:11.744788 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-505213430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-505213430',id=15,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-02pe6j7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:02Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=9992b23e-7582-49b6-977c-45dfc6f43ea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:03:11.744788 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:11.745013 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:38,bridge_name='br-int',has_traffic_filtering=True,id=ef5211c5-95b3-4091-804e-3e3da3b14d0b,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5211c5-95') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:11.748163 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'pci_devices' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:11.785521 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999534928999992 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:11.787072 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance destroyed successfully. May 27 21:03:11.788809 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lazy-loading 'resources' on Instance uuid 950bfe97-53fd-4086-bfa5-69ea3a75c088 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:11.858860 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:12.086528 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:03:12.087046 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:12.088067 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] VM Started (Lifecycle Event) May 27 21:03:12.088529 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:03:12.095628 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Instance spawned successfully. May 27 21:03:12.095628 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:03:12.252499 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] End _get_guest_xml xml= May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 9992b23e-7582-49b6-977c-45dfc6f43ea3 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: instance-0000000f May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 196608 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 1 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-server-505213430 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 2026-05-27 21:03:08 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 192 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 1 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 0 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 0 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 1 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: True May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: bare May 27 21:03:12.252499 np0000001553 nova-compute[98213]: qcow2 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 1 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 0 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: virtio May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member May 27 21:03:12.252499 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:03:12.252499 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 9992b23e-7582-49b6-977c-45dfc6f43ea3 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 9992b23e-7582-49b6-977c-45dfc6f43ea3 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: hvm May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 128 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 1 May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: Nehalem May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: 72582c17-9811-4887-aaf7-fa2d1fa07bda May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: May 27 21:03:12.252499 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:03:12.255638 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Preparing to wait for external event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:03:12.255638 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:12.255638 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:12.255638 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:12.255638 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-505213430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-505213430',id=15,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-02pe6j7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:02Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=9992b23e-7582-49b6-977c-45dfc6f43ea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:03:12.257559 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:12.258389 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:38,bridge_name='br-int',has_traffic_filtering=True,id=ef5211c5-95b3-4091-804e-3e3da3b14d0b,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5211c5-95') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:12.258553 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:38,bridge_name='br-int',has_traffic_filtering=True,id=ef5211c5-95b3-4091-804e-3e3da3b14d0b,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5211c5-95') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:03:12.261530 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.261793 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:12.262035 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:03:12.263355 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.263521 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2fd0e35-92b8-54ac-b376-275d037f8667', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:12.265213 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.265890 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:12.269919 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.272302 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.272492 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef5211c5-95, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:12.272852 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef5211c5-95, col_values=(('qos', UUID('9486ccb2-965a-4285-928b-7d45067e52be')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:12.273023 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef5211c5-95, col_values=(('external_ids', {'iface-id': 'ef5211c5-95b3-4091-804e-3e3da3b14d0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:78:38', 'vm-uuid': '9992b23e-7582-49b6-977c-45dfc6f43ea3'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:12.274843 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.276045 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:12.285501 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.286936 np0000001553 nova-compute[98213]: INFO os_vif [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:78:38,bridge_name='br-int',has_traffic_filtering=True,id=ef5211c5-95b3-4091-804e-3e3da3b14d0b,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5211c5-95') May 27 21:03:12.291005 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-636487866',display_name='tempest-ServerActionsTestOtherB-server-636487866',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000001553',hostname='tempest-serveractionstestotherb-server-636487866',id=9,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP37vEU7tk6IZLG6nGgYJrRWC1XysqG9qhj9f6Ts3gEcgfRgE2Kuebb5geAJYt0lQJDqjDBxoFON2pCBOOFgVRPjkb/YhHT2yjUMuBmc0jN1WzS2xreRxA0w+OzMqxnUwQ==',key_name='tempest-keypair-736936884',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:07Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=Flavor(12),node='np0000001553',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='3811fd8e033640e18a7080fe0a65d975',ramdisk_id='',reservation_id='r-004tqvtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1747713240',owner_user_name='tempest-ServerActionsTestOtherB-1747713240-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='606bde5cb68847cc8b7b2af092fc6bd6',uuid=950bfe97-53fd-4086-bfa5-69ea3a75c088,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:03:12.291272 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converting VIF {"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:12.291706 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:12.291908 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:03:12.294912 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.295087 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c501903-cc, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:12.299162 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.299162 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:12.306462 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.310803 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.313508 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=630f75b4-b184-4a5b-b05a-7dff76b30380) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:12.313508 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.313508 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.313508 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:12.319658 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6c19b1bf-066f-4c52-8022-9fa859161d8d req-a9f5081d-92b2-4bd9-9e7b-ca4a10b5c877 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:12.320582 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.323020 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6c19b1bf-066f-4c52-8022-9fa859161d8d req-a9f5081d-92b2-4bd9-9e7b-ca4a10b5c877 service nova] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:12.323296 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6c19b1bf-066f-4c52-8022-9fa859161d8d req-a9f5081d-92b2-4bd9-9e7b-ca4a10b5c877 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:12.323476 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6c19b1bf-066f-4c52-8022-9fa859161d8d req-a9f5081d-92b2-4bd9-9e7b-ca4a10b5c877 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:12.323604 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6c19b1bf-066f-4c52-8022-9fa859161d8d req-a9f5081d-92b2-4bd9-9e7b-ca4a10b5c877 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] No waiting events found dispatching network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:12.323725 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-6c19b1bf-066f-4c52-8022-9fa859161d8d req-a9f5081d-92b2-4bd9-9e7b-ca4a10b5c877 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received unexpected event network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c for instance with vm_state resized and task_state resize_reverting. May 27 21:03:12.325047 np0000001553 nova-compute[98213]: INFO os_vif [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') May 27 21:03:12.330125 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:03:12.330125 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:12.330125 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:12.330125 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:12.330125 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:03:12.330466 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:03:12.362606 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:12.362606 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:12.362606 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:12.362606 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:03:12.362606 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '19')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:12.362606 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '20')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:12.367425 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Resulting device map defaultdict(. at 0x79ceb0488c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'): ({'sdg'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:03:12.367425 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Removing multipathed devices sdf, sdg {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:03:12.367425 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Flush multipath device 330000000c5130650 {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:03:12.401641 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:03:12.446882 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:03:12.493636 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:03:12.493815 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:03:12.495513 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:03:12.507721 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:03:12.508996 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:03:12.525658 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:12.570962 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] May 27 21:03:12.570962 np0000001553 nova-compute[98213]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] successful. May 27 21:03:12.570962 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:12.585469 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:12.591961 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:12.593656 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:12.594297 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:12.603466 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:12.605158 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:12.605563 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:12.605893 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:12.606255 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:12.606550 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:12.610588 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:12.649078 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] May 27 21:03:12.649078 np0000001553 nova-compute[98213]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] successful. May 27 21:03:12.649078 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:12.679094 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:12.679094 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:12.679094 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] <== disconnect_volume: return (348ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:12.679094 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:03:12.962928 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:12.963071 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:12.963209 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Attaching volume 495837fb-9572-47a8-82af-4a6a5707f496 to /dev/vdb May 27 21:03:13.015632 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:13.033564 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:03:13.057945 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:13.092895 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:03:13.093282 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:03:13.103896 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:03:13.103896 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:13.104043 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] VM Paused (Lifecycle Event) May 27 21:03:13.106604 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:03:13.115925 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc', 'fe80::fc16:3eff:fe74:7207', 'fe80::fc16:3eff:fead:5cb7', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::b04a:b6ff:fe52:4741', 'fe80::fc16:3eff:fe62:2ad4'] May 27 21:03:13.116451 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:03:13.116538 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:03:13.117287 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Took 7.35 seconds to spawn the instance on the hypervisor. May 27 21:03:13.117823 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:13.118603 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:13.118603 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Updating existing volume attachment record: 52f6c6b6-8025-42bf-b65f-3e539db588cc {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:03:13.449202 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:13.510233 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ca912ce3-7bc7-4cb7-9936-2d6655082e4d req-1cfc13d4-f1de-45fa-a584-4c80d5fd4e58 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:13.510707 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ca912ce3-7bc7-4cb7-9936-2d6655082e4d req-1cfc13d4-f1de-45fa-a584-4c80d5fd4e58 service nova] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:13.510707 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ca912ce3-7bc7-4cb7-9936-2d6655082e4d req-1cfc13d4-f1de-45fa-a584-4c80d5fd4e58 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:13.510860 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ca912ce3-7bc7-4cb7-9936-2d6655082e4d req-1cfc13d4-f1de-45fa-a584-4c80d5fd4e58 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:13.510984 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ca912ce3-7bc7-4cb7-9936-2d6655082e4d req-1cfc13d4-f1de-45fa-a584-4c80d5fd4e58 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] No waiting events found dispatching network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:13.511100 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-ca912ce3-7bc7-4cb7-9936-2d6655082e4d req-1cfc13d4-f1de-45fa-a584-4c80d5fd4e58 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received unexpected event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 for instance with vm_state active and task_state None. May 27 21:03:13.617859 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:13.623999 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:13.623999 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] VM Resumed (Lifecycle Event) May 27 21:03:13.634256 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Took 13.50 seconds to build instance. May 27 21:03:13.696507 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:03:13.700212 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:13.700212 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:13.700212 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:13.700212 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:03:13.713043 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:13.714187 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:13.714673 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:13.714903 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:13.715795 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:13.716221 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:13.730262 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:13.730262 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:13.736838 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:13.736838 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:13.741556 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496] added May 27 21:03:13.741556 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:13.741556 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:13.741556 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:13.741556 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:13.741556 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:13.741556 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:13.741556 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:13.741821 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:13.742013 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:13.750198 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496] added May 27 21:03:13.750198 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:13.750198 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:13.750198 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:13.750198 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:13.750198 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:13.750198 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:13.751213 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:13.751213 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:13.751213 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:13.817380 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:13.817525 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:13.817630 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No VIF found with MAC fa:16:3e:df:78:38, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:13.818092 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Using config drive May 27 21:03:13.846413 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:13.846612 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:14.124314 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:14.128716 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:14.136062 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.026s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:14.325601 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:14.348776 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lazy-loading 'migration_context' on Instance uuid 950bfe97-53fd-4086-bfa5-69ea3a75c088 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:14.408380 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0008028419999845937 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:14.408928 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:14.409226 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:14.409439 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] VM Stopped (Lifecycle Event) May 27 21:03:14.410452 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.01870349600017107 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:14.410693 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.01844624900013514 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:14.429719 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005379279998578568 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:14.430010 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:14.430134 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=12.354840600999978 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:14.430455 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:14.430629 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=12.354351897000015 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:14.431095 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] VM Stopped (Lifecycle Event) May 27 21:03:14.450416 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-58ac63dd-6d78-49bc-91f8-fd1ac098d653 req-778de5c1-299b-4080-9a6b-b18e0a55744f service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:14.450416 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-58ac63dd-6d78-49bc-91f8-fd1ac098d653 req-778de5c1-299b-4080-9a6b-b18e0a55744f service nova] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:14.450416 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-58ac63dd-6d78-49bc-91f8-fd1ac098d653 req-778de5c1-299b-4080-9a6b-b18e0a55744f service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:14.450416 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-58ac63dd-6d78-49bc-91f8-fd1ac098d653 req-778de5c1-299b-4080-9a6b-b18e0a55744f service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:14.450416 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-58ac63dd-6d78-49bc-91f8-fd1ac098d653 req-778de5c1-299b-4080-9a6b-b18e0a55744f service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] No waiting events found dispatching network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:14.452935 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-58ac63dd-6d78-49bc-91f8-fd1ac098d653 req-778de5c1-299b-4080-9a6b-b18e0a55744f service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received unexpected event network-vif-unplugged-8c501903-cc36-46d4-9ca9-87394e07d00c for instance with vm_state resized and task_state resize_reverting. May 27 21:03:14.742366 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:14.751662 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:14.760554 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:14.760554 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:14.760554 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:14.777182 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:14.777182 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:14.777182 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:14.777182 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:14.785207 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:14.795705 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:14.804328 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:14.804328 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.804328 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:14.821026 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:14.821026 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.821026 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:14.821910 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Creating config drive at /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.config May 27 21:03:14.828109 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmwb0kutd {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:14.854090 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Object Instance<950bfe97-53fd-4086-bfa5-69ea3a75c088> lazy-loaded attributes: resources,migration_context {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:14.860527 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.50.100,3260] May 27 21:03:14.860527 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.50.100,3260] successful. May 27 21:03:14.860527 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:14.875831 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.40.100,3260] May 27 21:03:14.875831 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.40.100,3260] successful. May 27 21:03:14.875831 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:14.881056 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:14.891612 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:14.891612 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmwb0kutd" returned: 0 in 0.063s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:14.903512 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.903512 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.903512 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.903512 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.903512 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:14.903512 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:14.903512 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.903512 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.903512 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.903512 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.903512 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:14.905586 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.905586 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.905586 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.905586 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.905586 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:14.905586 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:14.905586 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.905586 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.905586 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.905586 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.905586 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:14.907155 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:14.907155 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:14.907419 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] HCTL ('11', '-', '-', 0) found on session 23 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:14.907540 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:14.911937 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: aac9c5e0-da16-44ef-b255-53b21d0cc63d] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:14.917717 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.917717 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.917717 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.917717 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.917717 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:14.917717 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:14.917717 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.917717 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.917717 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.917717 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.917717 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:14.922951 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.922951 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:14.922951 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.922951 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:14.922951 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:14.922951 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:14.922951 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.922951 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:14.922951 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.922951 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:14.922951 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:14.922951 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:14.923299 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:14.924635 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] HCTL ('12', '-', '-', 0) found on session 24 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:14.926032 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:14.926489 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching for a device in session 23 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:14.926702 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:14.934998 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-2ec42127-8ca7-44e8-b34b-4a4fb37d5c83 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d42a5fcb-8e0a-4f1a-8ff2-7c125e01f78d] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:14.947444 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching for a device in session 24 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:14.947606 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:15.408074 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:15.453404 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:15.517446 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:15.538564 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:15.609602 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:15.609841 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:15.632208 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:15.633191 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:15.715584 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:03:16.115660 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:16.294767 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:16.295103 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] VM Started (Lifecycle Event) May 27 21:03:16.556279 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Received event network-changed-cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:16.556610 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Refreshing instance network info cache due to event network-changed-cb1be979-cb37-4b4c-a7eb-f327cf20c66c. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:16.556610 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] Acquiring lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:16.556610 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] Acquired lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:16.556879 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Refreshing network info cache for port cb1be979-cb37-4b4c-a7eb-f327cf20c66c {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:16.652977 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "d92e4c8c-8850-42c6-b960-09e248044889" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:16.653301 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "d92e4c8c-8850-42c6-b960-09e248044889" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:16.737679 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Found WWN 3300000009a7456fc for multipath device dm-4 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:03:16.737679 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:16.737679 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000009a7456fc', 'path': '/dev/dm-4', 'multipath_id': '3300000009a7456fc'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:16.737679 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009a7456fc', 'path': '/dev/dm-4', 'multipath_id': '3300000009a7456fc'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:03:16.739756 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:16.741807 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lazy-loading 'flavor' on Instance uuid a8b6e8af-99d6-4ab7-82c7-68af9f22c24f {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:16.798444 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:16.800656 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:16.800778 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] VM Paused (Lifecycle Event) May 27 21:03:17.062882 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:17.135169 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.287s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:17.135169 np0000001553 nova-compute[98213]: DEBUG nova.compute.rpcapi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98213) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} May 27 21:03:17.159222 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:03:17.248175 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Attempting to attach volume 495837fb-9572-47a8-82af-4a6a5707f496 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:03:17.249047 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] attach device xml: May 27 21:03:17.249047 np0000001553 nova-compute[98213]: May 27 21:03:17.249047 np0000001553 nova-compute[98213]: May 27 21:03:17.249047 np0000001553 nova-compute[98213]: May 27 21:03:17.249047 np0000001553 nova-compute[98213]: May 27 21:03:17.249047 np0000001553 nova-compute[98213]: 495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:03:17.249047 np0000001553 nova-compute[98213]: May 27 21:03:17.249047 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:03:17.305485 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:17.309689 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:17.315097 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:17.489719 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:17.731457 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Updated VIF entry in instance network info cache for port cb1be979-cb37-4b4c-a7eb-f327cf20c66c. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:03:17.732993 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] [instance: 698b750b-959f-4358-b7a0-5f68e76f5a4a] Updating instance_info_cache with network_info: [{"id": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "address": "fa:16:3e:9e:34:0a", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb1be979-cb", "ovs_interfaceid": "cb1be979-cb37-4b4c-a7eb-f327cf20c66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:17.746755 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:17.747115 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:17.752559 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:03:17.752559 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Claim successful on node np0000001553 May 27 21:03:17.798001 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:17.816980 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:03:18.239365 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] Releasing lock "refresh_cache-698b750b-959f-4358-b7a0-5f68e76f5a4a" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:18.239529 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-changed-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:18.239639 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Refreshing instance network info cache due to event network-changed-bbe00ed4-45d2-4b31-a1c0-aadcf463da83. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:18.239767 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] Acquiring lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:18.239896 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] Acquired lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:18.240000 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Refreshing network info cache for port bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:18.703395 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Swapping old allocation on dict_keys(['486c0dc2-4a11-4ae8-b90f-d5afcfe85804']) held by migration 8a95cf4e-c2e9-4789-8ca0-4a57b8fb9f76 for instance May 27 21:03:18.744225 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:18.787425 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:18.836161 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Overwriting current allocation {'allocations': {'486c0dc2-4a11-4ae8-b90f-d5afcfe85804': {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}, 'generation': 21}}, 'project_id': '3811fd8e033640e18a7080fe0a65d975', 'user_id': '606bde5cb68847cc8b7b2af092fc6bd6', 'consumer_generation': 1} on consumer 950bfe97-53fd-4086-bfa5-69ea3a75c088 {{(pid=98213) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}} May 27 21:03:18.921926 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:18.922192 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:18.924213 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:18.924213 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No VIF found with MAC fa:16:3e:74:72:07, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:18.962669 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:19.071759 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:19.071862 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquired lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:19.071989 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:03:19.310280 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:19.512527 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updated VIF entry in instance network info cache for port bbe00ed4-45d2-4b31-a1c0-aadcf463da83. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:03:19.512916 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updating instance_info_cache with network_info: [{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:19.574203 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:19.666338 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:19.667055 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:20.015788 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4e5c9206-9c78-4546-8acc-456d6337daa5 req-7cfa5b01-bce7-442c-a523-341cab6e6de8 service nova] Releasing lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:20.047877 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:20.169689 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:20.326333 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating instance_info_cache with network_info: [{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:20.507460 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-7e57ee8c-62a2-4368-a528-1bc86741d218 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.544s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:20.689314 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.942s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:20.689748 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:03:20.831782 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Releasing lock "refresh_cache-950bfe97-53fd-4086-bfa5-69ea3a75c088" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:20.832197 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:20.845692 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:03:20.875774 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:20.914201 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:03:20.914370 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:03:20.923973 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:03:20.926353 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc', 'fe80::fc16:3eff:fe74:7207', 'fe80::fc16:3eff:fead:5cb7', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::b04a:b6ff:fe52:4741', 'fe80::fc16:3eff:fe62:2ad4', 'fe80::fc16:3eff:fedf:7838'] May 27 21:03:20.926494 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:03:20.927228 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:03:20.927228 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:20.943538 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:21.200753 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:03:21.201201 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:03:21.201358 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:21.201662 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:21.306204 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac9557e825354813ac31afa70f07ffc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '251237411f6e4bb49303c88852d6e9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:03:21.706228 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:03:21.749443 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:21.859171 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Successfully created port: e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:03:22.048998 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Starting finish_revert_migration {{(pid=98213) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}} May 27 21:03:22.069926 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Start _get_guest_xml network_info=[{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '950bfe97-53fd-4086-bfa5-69ea3a75c088', 'attached_at': '2026-05-27T21:03:21.000000', 'detached_at': '', 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'serial': '23f1203c-2f1d-487c-8874-bb9efa65e764'}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '5b7f7a8c-1084-44f3-a710-b0f487e77bcb', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:03:22.075318 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:03:22.075318 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-636487866', uuid='950bfe97-53fd-4086-bfa5-69ea3a75c088'), owner=OwnerMeta(userid='606bde5cb68847cc8b7b2af092fc6bd6', username='tempest-ServerActionsTestOtherB-1747713240-project-member', projectid='3811fd8e033640e18a7080fe0a65d975', projectname='tempest-ServerActionsTestOtherB-1747713240'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915802.0744793) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:03:22.077241 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:03:22.077677 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:03:22.078654 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:03:22.079166 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:03:22.079996 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:03:22.080366 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:03:22.080809 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:03:22.080809 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:03:22.080809 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:03:22.080910 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:03:22.081794 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:03:22.081794 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:03:22.081794 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:03:22.081794 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:03:22.082240 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:03:22.082392 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:03:22.082637 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lazy-loading 'vcpu_model' on Instance uuid 950bfe97-53fd-4086-bfa5-69ea3a75c088 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:22.212427 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:03:22.290746 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Rebuilding instance May 27 21:03:22.316629 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:22.434663 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Successfully updated port: e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:03:22.485933 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:22.528192 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7b11d4bb-a8ec-4de5-b707-e97b3821bdaf req-3270d0bb-9d2a-4564-aa90-aa19c4f79337 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Received event network-changed-e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:22.528192 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7b11d4bb-a8ec-4de5-b707-e97b3821bdaf req-3270d0bb-9d2a-4564-aa90-aa19c4f79337 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Refreshing instance network info cache due to event network-changed-e2c88b36-e738-45b0-8280-cb54bfc3a4ea. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:22.528192 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b11d4bb-a8ec-4de5-b707-e97b3821bdaf req-3270d0bb-9d2a-4564-aa90-aa19c4f79337 service nova] Acquiring lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:22.528192 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b11d4bb-a8ec-4de5-b707-e97b3821bdaf req-3270d0bb-9d2a-4564-aa90-aa19c4f79337 service nova] Acquired lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:22.528192 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-7b11d4bb-a8ec-4de5-b707-e97b3821bdaf req-3270d0bb-9d2a-4564-aa90-aa19c4f79337 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Refreshing network info cache for port e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:22.609470 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.config --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:22.702783 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:22.705184 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "/opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:22.705184 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "/opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:22.705184 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "/opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:22.705184 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:03:22.705949 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:22.706307 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:22.706898 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:22.707593 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:03:22.724697 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:22.725410 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:22.726462 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:22.726462 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:22.726654 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:22.726843 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:22.747486 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:22.747486 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:22.756745 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:22.756745 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:22.762803 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764] added May 27 21:03:22.762803 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:22.762803 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:22.762803 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:22.762803 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:22.762803 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:22.762803 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:22.763030 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:22.763734 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:22.764914 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:22.769891 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764] added May 27 21:03:22.769891 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:22.769891 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:22.769891 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:22.769891 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:22.769891 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:22.769891 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:22.770132 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:22.770856 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0433(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:22.770856 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:22.938728 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:22.966066 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-3d420ff6-7a82-4cb9-8664-583d5e9efb71 req-8a64a4f4-9731-4505-9d83-dac8acd286f0 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:22.968348 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3d420ff6-7a82-4cb9-8664-583d5e9efb71 req-8a64a4f4-9731-4505-9d83-dac8acd286f0 service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:22.968348 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3d420ff6-7a82-4cb9-8664-583d5e9efb71 req-8a64a4f4-9731-4505-9d83-dac8acd286f0 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:22.968348 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3d420ff6-7a82-4cb9-8664-583d5e9efb71 req-8a64a4f4-9731-4505-9d83-dac8acd286f0 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:22.968348 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-3d420ff6-7a82-4cb9-8664-583d5e9efb71 req-8a64a4f4-9731-4505-9d83-dac8acd286f0 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Processing event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:03:22.968676 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:03:22.972195 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:22.972676 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] VM Resumed (Lifecycle Event) May 27 21:03:22.974134 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:03:22.978472 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Instance spawned successfully. May 27 21:03:22.980525 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:03:23.029844 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-7b11d4bb-a8ec-4de5-b707-e97b3821bdaf req-3270d0bb-9d2a-4564-aa90-aa19c4f79337 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:23.117089 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-7b11d4bb-a8ec-4de5-b707-e97b3821bdaf req-3270d0bb-9d2a-4564-aa90-aa19c4f79337 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:03:23.224132 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:03:23.225392 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:03:23.225653 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Creating image(s) May 27 21:03:23.226164 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "/opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:23.227182 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "/opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:23.227736 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "/opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:23.228362 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:23.231995 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:23.234110 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:23.319056 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-7b11d4bb-a8ec-4de5-b707-e97b3821bdaf req-3270d0bb-9d2a-4564-aa90-aa19c4f79337 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:23.322680 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.088s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:23.323420 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:23.323730 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:23.324351 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:23.327950 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:23.327950 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:23.418155 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.090s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:23.418669 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:23.465929 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk 1073741824" returned: 0 in 0.047s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:23.466544 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.143s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:23.466996 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:23.484998 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:23.496135 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:23.496135 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:23.496135 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:23.496135 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:23.496135 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:23.496135 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:23.506468 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:23.538441 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:23.542764 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:23.572814 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:23.661863 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:23.663378 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Cleaning up deleted instances {{(pid=98213) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}} May 27 21:03:23.686047 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.219s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:23.686685 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:03:23.687320 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:23.735204 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:23.743233 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:23.764985 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:23.772639 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:23.783232 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:23.783232 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:23.783232 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:23.793550 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:23.793550 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:23.793550 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:23.793550 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:23.796106 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:23.796106 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Cannot resize image /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:03:23.796106 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:03:23.796106 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Ensure instance console log exists: /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:03:23.796106 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:23.796106 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:23.796106 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:23.800165 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:23.811168 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:23.821297 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:23.821297 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.821297 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:23.821926 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b11d4bb-a8ec-4de5-b707-e97b3821bdaf req-3270d0bb-9d2a-4564-aa90-aa19c4f79337 service nova] Releasing lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:23.824732 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquired lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:23.824732 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:03:23.852342 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-3cc4cc0a-e536-4577-8a1c-ccce9b191e3e req-a3c0ba76-147b-4e9b-b2cc-dcde7ecf6077 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:23.855404 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.855404 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:23.855404 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3cc4cc0a-e536-4577-8a1c-ccce9b191e3e req-a3c0ba76-147b-4e9b-b2cc-dcde7ecf6077 service nova] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:23.858645 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.858645 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:23.859742 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3cc4cc0a-e536-4577-8a1c-ccce9b191e3e req-a3c0ba76-147b-4e9b-b2cc-dcde7ecf6077 service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:23.868829 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-3cc4cc0a-e536-4577-8a1c-ccce9b191e3e req-a3c0ba76-147b-4e9b-b2cc-dcde7ecf6077 service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.010s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:23.869116 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-3cc4cc0a-e536-4577-8a1c-ccce9b191e3e req-a3c0ba76-147b-4e9b-b2cc-dcde7ecf6077 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] No waiting events found dispatching network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:23.869497 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-3cc4cc0a-e536-4577-8a1c-ccce9b191e3e req-a3c0ba76-147b-4e9b-b2cc-dcde7ecf6077 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received unexpected event network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb for instance with vm_state active and task_state rebuilding. May 27 21:03:23.890234 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] May 27 21:03:23.890234 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] successful. May 27 21:03:23.890234 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:23.894813 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Instance destroyed successfully. May 27 21:03:23.908648 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:23.932889 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] May 27 21:03:23.932889 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] successful. May 27 21:03:23.932889 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:23.939634 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.939634 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:23.940004 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.940004 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:23.940356 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:23.941785 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:23.943125 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] HCTL ('18', '-', '-', 0) found on session 26 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:23.943324 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:23.944953 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:23.966020 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching for a device in session 26 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:23.966020 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:23.980878 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.980878 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:23.981315 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:23.981315 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:23.981551 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.255s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:23.981551 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:23.983431 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] HCTL ('19', '-', '-', 0) found on session 27 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:23.983544 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:23.990191 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Detaching volume 495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:03:24.007712 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Searching for a device in session 27 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:24.007712 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:24.017335 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Took 15.86 seconds to spawn the instance on the hypervisor. May 27 21:03:24.017620 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:24.020530 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:03:24.020904 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999856094000052 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:24.079945 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Attempting to driver detach volume 495837fb-9572-47a8-82af-4a6a5707f496 from mountpoint /dev/vdb May 27 21:03:24.090309 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Found disk vdb by alias ua-495837fb-9572-47a8-82af-4a6a5707f496 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:03:24.090453 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Attempting to detach device vdb from instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:03:24.091746 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] detach device xml: May 27 21:03:24.091746 np0000001553 nova-compute[98213]: May 27 21:03:24.091746 np0000001553 nova-compute[98213]: May 27 21:03:24.091746 np0000001553 nova-compute[98213]: May 27 21:03:24.091746 np0000001553 nova-compute[98213]: May 27 21:03:24.091746 np0000001553 nova-compute[98213]: 495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:03:24.091746 np0000001553 nova-compute[98213]:
May 27 21:03:24.091746 np0000001553 nova-compute[98213]: May 27 21:03:24.091746 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:03:24.101462 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Successfully detached device vdb from instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f from the persistent domain config. May 27 21:03:24.102634 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:03:24.103222 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:24.103732 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:24.166464 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] There are 0 instances to clean {{(pid=98213) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}} May 27 21:03:24.167371 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:24.167550 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Cleaning up deleted instances with incomplete migration {{(pid=98213) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}} May 27 21:03:24.389358 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:03:24.499424 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:24.536103 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Took 27.50 seconds to build instance. May 27 21:03:24.567223 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:24.674263 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:24.709552 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Updating instance_info_cache with network_info: [{"id": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "address": "fa:16:3e:65:89:2c", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2c88b36-e7", "ovs_interfaceid": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:24.728780 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:03:24.795828 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:25.037503 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bc866539-f53b-4756-8248-c79553f96514 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 29.008s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:25.071585 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8f37eeea-9f56-47f4-a25b-7ae8ef4ad88d req-893d3188-724b-4dc2-8799-90efc5b234bb service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:25.071742 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8f37eeea-9f56-47f4-a25b-7ae8ef4ad88d req-893d3188-724b-4dc2-8799-90efc5b234bb service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:25.071879 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8f37eeea-9f56-47f4-a25b-7ae8ef4ad88d req-893d3188-724b-4dc2-8799-90efc5b234bb service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:25.071997 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-8f37eeea-9f56-47f4-a25b-7ae8ef4ad88d req-893d3188-724b-4dc2-8799-90efc5b234bb service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:25.072094 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-8f37eeea-9f56-47f4-a25b-7ae8ef4ad88d req-893d3188-724b-4dc2-8799-90efc5b234bb service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:25.072241 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-8f37eeea-9f56-47f4-a25b-7ae8ef4ad88d req-893d3188-724b-4dc2-8799-90efc5b234bb service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received unexpected event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with vm_state active and task_state None. May 27 21:03:25.175981 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:03:25.212503 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Releasing lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:25.212756 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Instance network_info: |[{"id": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "address": "fa:16:3e:65:89:2c", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2c88b36-e7", "ovs_interfaceid": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:03:25.214456 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Start _get_guest_xml network_info=[{"id": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "address": "fa:16:3e:65:89:2c", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2c88b36-e7", "ovs_interfaceid": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:03:25.216106 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:03:25.217246 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='d92e4c8c-8850-42c6-b960-09e248044889'), owner=OwnerMeta(userid='ac9557e825354813ac31afa70f07ffc7', username='tempest-AttachVolumeMultiAttachTest-1088868426-project-member', projectid='251237411f6e4bb49303c88852d6e9a1', projectname='tempest-AttachVolumeMultiAttachTest-1088868426'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "address": "fa:16:3e:65:89:2c", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2c88b36-e7", "ovs_interfaceid": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915805.216897) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:03:25.218134 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:03:25.218476 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:03:25.219154 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:03:25.219327 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:03:25.220154 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:03:25.220522 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:03:25.220728 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:03:25.220807 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:03:25.220900 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:03:25.220992 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:03:25.221095 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:03:25.221258 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:03:25.221351 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:03:25.221477 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:03:25.221560 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:03:25.221678 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:03:25.239351 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='multiattach-server-1',id=17,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-j6jmfjd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=d92e4c8c-8850-42c6-b960-09e248044889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "address": "fa:16:3e:65:89:2c", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2c88b36-e7", "ovs_interfaceid": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:03:25.239579 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "address": "fa:16:3e:65:89:2c", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2c88b36-e7", "ovs_interfaceid": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:25.239992 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:89:2c,bridge_name='br-int',has_traffic_filtering=True,id=e2c88b36-e738-45b0-8280-cb54bfc3a4ea,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2c88b36-e7') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:25.246888 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'pci_devices' on Instance uuid d92e4c8c-8850-42c6-b960-09e248044889 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:25.746157 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Found WWN 330000000c5130650 for multipath device dm-9 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:03:25.746157 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:25.746157 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000c5130650', 'path': '/dev/dm-9', 'multipath_id': '330000000c5130650'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:25.746157 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c5130650', 'path': '/dev/dm-9', 'multipath_id': '330000000c5130650'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:03:25.746712 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.643s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:25.746750 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:03:25.747321 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:03:25.753799 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] End _get_guest_xml xml= May 27 21:03:25.753799 np0000001553 nova-compute[98213]: d92e4c8c-8850-42c6-b960-09e248044889 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: instance-00000011 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 196608 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 1 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: multiattach-server-1 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 2026-05-27 21:03:25 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 192 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 1 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 0 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 0 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 1 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: True May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: bare May 27 21:03:25.753799 np0000001553 nova-compute[98213]: qcow2 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 1 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 0 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: virtio May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426-project-member May 27 21:03:25.753799 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:03:25.753799 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: d92e4c8c-8850-42c6-b960-09e248044889 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: d92e4c8c-8850-42c6-b960-09e248044889 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: hvm May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 128 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: 1 May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: Nehalem May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: May 27 21:03:25.753799 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:03:25.758671 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Preparing to wait for external event network-vif-plugged-e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:03:25.758817 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "d92e4c8c-8850-42c6-b960-09e248044889-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:25.758954 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "d92e4c8c-8850-42c6-b960-09e248044889-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:25.759073 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "d92e4c8c-8850-42c6-b960-09e248044889-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:25.759792 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='multiattach-server-1',id=17,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-j6jmfjd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=d92e4c8c-8850-42c6-b960-09e248044889,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "address": "fa:16:3e:65:89:2c", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2c88b36-e7", "ovs_interfaceid": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:03:25.759792 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "address": "fa:16:3e:65:89:2c", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2c88b36-e7", "ovs_interfaceid": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:25.761248 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:89:2c,bridge_name='br-int',has_traffic_filtering=True,id=e2c88b36-e738-45b0-8280-cb54bfc3a4ea,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2c88b36-e7') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:25.762850 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:89:2c,bridge_name='br-int',has_traffic_filtering=True,id=e2c88b36-e738-45b0-8280-cb54bfc3a4ea,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2c88b36-e7') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:03:25.763255 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:25.763467 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:25.763683 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:03:25.767533 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:25.768094 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c02800c3-5417-5d76-948b-2f179ae33946', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:25.769476 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:25.769476 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:25.776223 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:25.776223 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:25.776223 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:25.776223 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:03:25.777023 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '24')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:25.777927 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '23')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:25.779099 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:25.785703 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Resulting device map defaultdict(. at 0x79ced0190e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'): ({'sdf'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:03:25.785996 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Removing multipathed devices sdf, sdg {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:03:25.786285 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Flush multipath device 3300000009a7456fc {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:03:25.790473 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:25.792494 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2c88b36-e7, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:25.793789 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2c88b36-e7, col_values=(('qos', UUID('285c6dfd-9764-48fa-9e8b-7953f103abce')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:25.794100 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2c88b36-e7, col_values=(('external_ids', {'iface-id': 'e2c88b36-e738-45b0-8280-cb54bfc3a4ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:89:2c', 'vm-uuid': 'd92e4c8c-8850-42c6-b960-09e248044889'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:25.796113 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:25.796113 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:25.804912 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:25.805103 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:25.809341 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:25.810448 np0000001553 nova-compute[98213]: INFO os_vif [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:89:2c,bridge_name='br-int',has_traffic_filtering=True,id=e2c88b36-e738-45b0-8280-cb54bfc3a4ea,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2c88b36-e7') May 27 21:03:25.815805 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:03:25.865013 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:03:25.922583 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:03:25.924321 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:03:25.926487 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:03:25.942772 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:03:25.942882 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:03:25.964440 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:25.975904 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-88fe986d-702d-4655-b18a-657e711c76aa req-118ddc89-aea7-49c9-abec-9242cea0a126 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:25.976108 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-88fe986d-702d-4655-b18a-657e711c76aa req-118ddc89-aea7-49c9-abec-9242cea0a126 service nova] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:25.978682 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-88fe986d-702d-4655-b18a-657e711c76aa req-118ddc89-aea7-49c9-abec-9242cea0a126 service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:25.980241 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-88fe986d-702d-4655-b18a-657e711c76aa req-118ddc89-aea7-49c9-abec-9242cea0a126 service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:25.980241 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-88fe986d-702d-4655-b18a-657e711c76aa req-118ddc89-aea7-49c9-abec-9242cea0a126 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] No waiting events found dispatching network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:25.980241 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-88fe986d-702d-4655-b18a-657e711c76aa req-118ddc89-aea7-49c9-abec-9242cea0a126 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received unexpected event network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb for instance with vm_state active and task_state rebuilding. May 27 21:03:26.017053 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.40.100,3260] May 27 21:03:26.017053 np0000001553 nova-compute[98213]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.40.100,3260] successful. May 27 21:03:26.017053 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:26.046345 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:26.067485 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:26.123642 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.50.100,3260] May 27 21:03:26.123642 np0000001553 nova-compute[98213]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.50.100,3260] successful. May 27 21:03:26.123642 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:26.158619 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:26.159483 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:26.159483 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] <== disconnect_volume: return (2055ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:26.159483 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:03:26.258055 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-636487866',display_name='tempest-ServerActionsTestOtherB-server-636487866',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serveractionstestotherb-server-636487866',id=9,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP37vEU7tk6IZLG6nGgYJrRWC1XysqG9qhj9f6Ts3gEcgfRgE2Kuebb5geAJYt0lQJDqjDBxoFON2pCBOOFgVRPjkb/YhHT2yjUMuBmc0jN1WzS2xreRxA0w+OzMqxnUwQ==',key_name='tempest-keypair-736936884',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:07Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001553',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3811fd8e033640e18a7080fe0a65d975',ramdisk_id='',reservation_id='r-004tqvtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1747713240',owner_user_name='tempest-ServerActionsTestOtherB-1747713240-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='606bde5cb68847cc8b7b2af092fc6bd6',uuid=950bfe97-53fd-4086-bfa5-69ea3a75c088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:03:26.258331 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converting VIF {"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:26.258752 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:26.261941 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] End _get_guest_xml xml= May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 950bfe97-53fd-4086-bfa5-69ea3a75c088 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: instance-00000009 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 196608 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 1 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherB-server-636487866 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 2026-05-27 21:03:22 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 192 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 1 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 0 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 0 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 1 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: True May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: bare May 27 21:03:26.261941 np0000001553 nova-compute[98213]: qcow2 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 1 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 0 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: ide May 27 21:03:26.261941 np0000001553 nova-compute[98213]: virtio May 27 21:03:26.261941 np0000001553 nova-compute[98213]: pc May 27 21:03:26.261941 np0000001553 nova-compute[98213]: virtio May 27 21:03:26.261941 np0000001553 nova-compute[98213]: virtio May 27 21:03:26.261941 np0000001553 nova-compute[98213]: virtio May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherB-1747713240-project-member May 27 21:03:26.261941 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherB-1747713240 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:03:26.261941 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 950bfe97-53fd-4086-bfa5-69ea3a75c088 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 950bfe97-53fd-4086-bfa5-69ea3a75c088 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: hvm May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 128 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 1 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: Nehalem May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: 23f1203c-2f1d-487c-8874-bb9efa65e764 May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: May 27 21:03:26.261941 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:03:26.263782 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Preparing to wait for external event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:03:26.263782 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:26.263782 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:26.263958 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:26.264692 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-636487866',display_name='tempest-ServerActionsTestOtherB-server-636487866',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serveractionstestotherb-server-636487866',id=9,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP37vEU7tk6IZLG6nGgYJrRWC1XysqG9qhj9f6Ts3gEcgfRgE2Kuebb5geAJYt0lQJDqjDBxoFON2pCBOOFgVRPjkb/YhHT2yjUMuBmc0jN1WzS2xreRxA0w+OzMqxnUwQ==',key_name='tempest-keypair-736936884',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:07Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001553',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3811fd8e033640e18a7080fe0a65d975',ramdisk_id='',reservation_id='r-004tqvtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1747713240',owner_user_name='tempest-ServerActionsTestOtherB-1747713240-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='606bde5cb68847cc8b7b2af092fc6bd6',uuid=950bfe97-53fd-4086-bfa5-69ea3a75c088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:03:26.264880 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converting VIF {"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:26.265542 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:26.266238 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:03:26.267385 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.268695 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:26.268695 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:03:26.269999 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.269999 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba92b8c4-16bc-5bb1-91f6-86d37a709949', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:26.274786 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.275337 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:26.285937 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.289259 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.289422 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c501903-cc, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:26.290082 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c501903-cc, col_values=(('qos', UUID('4190bf51-292b-4c23-8b26-8b11fa9fc1d7')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:26.290082 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c501903-cc, col_values=(('external_ids', {'iface-id': '8c501903-cc36-46d4-9ca9-87394e07d00c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:3a:d3', 'vm-uuid': '950bfe97-53fd-4086-bfa5-69ea3a75c088'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:26.292477 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.293739 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:26.307600 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Detaching volume aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 May 27 21:03:26.308783 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.312584 np0000001553 nova-compute[98213]: INFO os_vif [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') May 27 21:03:26.373729 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Attempting to driver detach volume aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 from mountpoint /dev/vdb May 27 21:03:26.385726 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Found disk vdb by alias ua-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:03:26.388972 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Found disk vdb by alias ua-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:03:26.389103 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Attempting to detach device vdb from instance 22e422c7-47a4-4619-92a8-b05b73989943 from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:03:26.390542 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] detach device xml: May 27 21:03:26.390542 np0000001553 nova-compute[98213]: May 27 21:03:26.390542 np0000001553 nova-compute[98213]: May 27 21:03:26.390542 np0000001553 nova-compute[98213]: May 27 21:03:26.390542 np0000001553 nova-compute[98213]: May 27 21:03:26.390542 np0000001553 nova-compute[98213]: aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 May 27 21:03:26.390542 np0000001553 nova-compute[98213]:
May 27 21:03:26.390542 np0000001553 nova-compute[98213]: May 27 21:03:26.390542 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:03:26.397695 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Successfully detached device vdb from instance 22e422c7-47a4-4619-92a8-b05b73989943 from the persistent domain config. May 27 21:03:26.397824 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] (1/8): Attempting to detach device vdb with device alias ua-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 from instance 22e422c7-47a4-4619-92a8-b05b73989943 from the live domain config. {{(pid=98213) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} May 27 21:03:26.398027 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] detach device xml: May 27 21:03:26.398027 np0000001553 nova-compute[98213]: May 27 21:03:26.398027 np0000001553 nova-compute[98213]: May 27 21:03:26.398027 np0000001553 nova-compute[98213]: May 27 21:03:26.398027 np0000001553 nova-compute[98213]: May 27 21:03:26.398027 np0000001553 nova-compute[98213]: aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 May 27 21:03:26.398027 np0000001553 nova-compute[98213]:
May 27 21:03:26.398027 np0000001553 nova-compute[98213]: May 27 21:03:26.398027 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:03:26.714635 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.747194 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.785707 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000598052999976062 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:26.786299 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:26.786566 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Stopped (Lifecycle Event) May 27 21:03:26.788335 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:26.788335 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=12.232581854000045 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:26.788335 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=12.232422328999974 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:26.855488 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.898106 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.900316 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:26.982200 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Received event ua-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98213) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} May 27 21:03:26.989112 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 for instance 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} May 27 21:03:26.998722 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Successfully detached device vdb from instance 22e422c7-47a4-4619-92a8-b05b73989943 from the live domain config. May 27 21:03:27.003996 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:03:27.004420 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:27.004620 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:27.005318 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:27.005392 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:03:27.005581 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:03:27.038855 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Rescuing May 27 21:03:27.039197 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:27.039342 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquired lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:27.039506 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:03:27.041236 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:27.041236 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:27.041236 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:27.042272 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:03:27.042272 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '11')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:27.044206 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1', '12')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:27.045467 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Resulting device map defaultdict(. at 0x79ced0217560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'): ({'sdk'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:03:27.045810 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Removing multipathed devices sdk, sdj {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:03:27.046722 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Flush multipath device 330000000e3776757 {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:03:27.088742 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:03:27.141261 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:03:27.159314 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.173726 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:27.174360 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:27.174687 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:27.175098 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:03:27.183555 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:03:27.183887 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:03:27.185573 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:03:27.200838 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:03:27.201110 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:03:27.213796 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:27.254495 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1, portal: 192.168.40.100,3260] May 27 21:03:27.254495 np0000001553 nova-compute[98213]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1, portal: 192.168.40.100,3260] successful. May 27 21:03:27.254495 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:27.277900 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:27.296191 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96163965-2cf5-45bd-8caa-4c125a8c4668 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:27.296621 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Instance destroyed successfully. May 27 21:03:27.298067 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1815635338',display_name='tempest-ServerActionsTestOtherA-server-1150672827',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-tempest-common-compute-instance-1815635338',id=13,image_ref='e25494d4-a649-4a75-ab22-12240ef97c22',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhRyl/gHlTk3NR31kz1TMU4ugUtNRNhvt3/is5Ou9Gh8FfxeQaQSkn9eAA9+1tgiBOuvzlKK/vItMkljBAUDewfhHBGnxPq32YISNTcCVOesxqFgmJRR6kSx4SB246g4g==',key_name='tempest-keypair-1121332834',keypairs=,launch_index=0,launched_at=2026-05-27T21:02:30Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b562b6a1ba2b4c3ab101af22f9d04713',ramdisk_id='',reservation_id='r-mometahb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e25494d4-a649-4a75-ab22-12240ef97c22',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-113699651',owner_user_name='tempest-ServerActionsTestOtherA-113699651-project-member'},tags=,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99659c2947e743c899512883f5a85b0e',uuid=a8b6e8af-99d6-4ab7-82c7-68af9f22c24f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:03:27.301159 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:27.301159 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converting VIF {"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:27.301614 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:27.301928 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:03:27.306453 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.306737 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2dc1bc4-0c, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:27.307717 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.308472 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:27.318667 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.323783 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.326799 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.326799 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=808bf6b7-e07f-46ac-b4c8-34c16fe20cee) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:27.326799 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.326799 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:27.334186 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.334186 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.339176 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:27.339176 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:27.339176 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No VIF found with MAC fa:16:3e:65:89:2c, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:27.340806 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Using config drive May 27 21:03:27.343189 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1, portal: 192.168.50.100,3260] May 27 21:03:27.343189 np0000001553 nova-compute[98213]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-aef35a4e-71cd-4cfe-8dc6-ac9de0faefd1, portal: 192.168.50.100,3260] successful. May 27 21:03:27.343189 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:27.366946 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.368079 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.373911 np0000001553 nova-compute[98213]: INFO os_vif [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') May 27 21:03:27.375440 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:27.375543 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:27.375828 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] <== disconnect_volume: return (371ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:27.376157 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:03:27.386227 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:03:27.386227 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:27.386227 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:27.389979 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:27.390428 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:03:27.392181 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:03:27.428751 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:27.428751 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:27.428751 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:27.428751 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:03:27.428751 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, 0): [] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:27.429495 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496') {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} May 27 21:03:27.429651 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, 0): [] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:27.429806 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496') {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} May 27 21:03:27.429962 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Resulting device map defaultdict(. at 0x79ced0190040>, {}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:03:27.430164 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Disconnecting from: [] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:03:27.430413 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:27.430543 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] <== disconnect_volume: return (45ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:27.430700 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:03:27.431072 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Deleting instance files /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f_del May 27 21:03:27.432378 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Deletion of /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f_del complete May 27 21:03:27.543725 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:27.656752 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:27.657165 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:03:27.659492 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager.update_available_resource {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:27.859583 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:27.912631 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:27.961748 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:27.961748 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Started (Lifecycle Event) May 27 21:03:27.967709 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:27.971779 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'flavor' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:28.057916 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Creating config drive at /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk.config May 27 21:03:28.061936 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpegj_q_in {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:28.123555 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpegj_q_in" returned: 0 in 0.061s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:28.168176 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:28.168176 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:28.168176 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:28.168176 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Auditing locally available compute resources for np0000001553 (node: np0000001553) {{(pid=98213) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} May 27 21:03:28.213978 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Updating instance_info_cache with network_info: [{"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:28.448255 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Booting with volume 495837fb-9572-47a8-82af-4a6a5707f496 at /dev/vdb May 27 21:03:28.465094 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:28.469078 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:28.469078 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Paused (Lifecycle Event) May 27 21:03:28.511646 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:28.530863 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:03:28.559241 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:28.592450 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:03:28.593438 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:03:28.603131 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:03:28.605002 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc', 'fe80::fc16:3eff:fead:5cb7', 'fe80::fc16:3eff:fe6e:ec22', 'fe80::b04a:b6ff:fe52:4741', 'fe80::fc16:3eff:fe62:2ad4', 'fe80::fc16:3eff:fedf:7838', 'fe80::fc16:3eff:fe83:3ad3', 'fe80::f44b:ecff:feb6:e23'] May 27 21:03:28.605214 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:03:28.608953 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:03:28.609256 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:28.609532 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Updating existing volume attachment record: 19efdc6d-3137-41e6-908f-0b398f8679b1 {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:03:28.644098 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:28.683915 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:28.720272 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Releasing lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:28.777528 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:28.852665 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:28.854180 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:28.972588 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:28.974191 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 3 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:28.985885 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d88da781-b40e-428c-8264-e62d22131cce tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.181s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:29.478699 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] During sync_power_state the instance has a pending task (resize_reverting). Skip. May 27 21:03:29.676941 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:29.677087 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d92e4c8c-8850-42c6-b960-09e248044889] VM Started (Lifecycle Event) May 27 21:03:29.697296 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquiring lock "90152e6a-b6ed-44f4-a430-fed4fa027496" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:29.697539 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:29.903287 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:29.956165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:29.956165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:29.956165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "22e422c7-47a4-4619-92a8-b05b73989943-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:29.956165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:29.956165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:29.963422 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Terminating instance May 27 21:03:29.997232 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:29.997749 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:30.071403 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:30.074850 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:03:30.076630 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:30.157601 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:30.160183 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:30.180940 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:30.183713 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:30.183840 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d92e4c8c-8850-42c6-b960-09e248044889] VM Paused (Lifecycle Event) May 27 21:03:30.202657 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:03:30.261498 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:30.262089 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:03:30.264226 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:30.300583 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.365828 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:30.366300 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:30.394169 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.415599 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.469218 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:03:30.480779 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:30.495040 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:03:30.513430 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.514841 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.540647 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.582588 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.594372 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.614609 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.645342 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.648107 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.681110 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:30.701152 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:30.713526 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:30.765719 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:03:30.765905 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Creating image(s) May 27 21:03:30.766502 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:30.766737 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "/opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:30.769054 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "/opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:30.769054 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "0187e0e2a7ad0e4262a85ccea59eac884f57dece" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:30.770175 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "0187e0e2a7ad0e4262a85ccea59eac884f57dece" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:30.799767 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:30.803346 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:30.838910 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.849480 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:30.849480 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:30.863938 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:03:30.864201 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Claim successful on node np0000001553 May 27 21:03:30.872957 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Instance destroyed successfully. May 27 21:03:30.878168 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.878842 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'numa_topology' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:30.883340 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Instance destroyed successfully. May 27 21:03:30.886246 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lazy-loading 'resources' on Instance uuid 22e422c7-47a4-4619-92a8-b05b73989943 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:30.886610 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:30.918651 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:30.925589 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.045121 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.046516 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.159458 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.165049 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.223282 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d92e4c8c-8850-42c6-b960-09e248044889] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:03:31.225311 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999573090000013 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:31.225744 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999810508999872 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:31.262011 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.263999 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.274175 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.286387 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.288314 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.317047 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.328639 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.354231 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.361325 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.393162 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-825501870',display_name='tempest-ServerStableDeviceRescueTest-server-825501870',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverstabledevicerescuetest-server-825501870',id=2,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGg1/9242vIbx6vjuoAaueOs/ycrtrXLSIRHl3kBo44NyGftUde+Q5/v9QeELCwC81jYOXCHSIshR3t5+UTnEBpZoHz1vAbfMO55j2RFIjE2iyvknOrzgj26SooPwTYUvA==',key_name='tempest-keypair-85036239',keypairs=,launch_index=0,launched_at=2026-05-27T21:02:46Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='92da496690954c8fb9c6eb722b956485',ramdisk_id='',reservation_id='r-x4fpd3kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-382424917',owner_user_name='tempest-ServerStableDeviceRescueTest-382424917-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6e7f263d257406d8c7b8ab607d0e609',uuid=22e422c7-47a4-4619-92a8-b05b73989943,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:03:31.395267 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Converting VIF {"id": "b8698723-2577-4f03-aa99-ea06a904c148", "address": "fa:16:3e:6e:ec:22", "network": {"id": "3506bf24-d962-44d8-ae8b-5f10ebe7fa2d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-933597320-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "92da496690954c8fb9c6eb722b956485", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8698723-25", "ovs_interfaceid": "b8698723-2577-4f03-aa99-ea06a904c148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:31.397231 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ec:22,bridge_name='br-int',has_traffic_filtering=True,id=b8698723-2577-4f03-aa99-ea06a904c148,network=Network(3506bf24-d962-44d8-ae8b-5f10ebe7fa2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8698723-25') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:31.397231 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ec:22,bridge_name='br-int',has_traffic_filtering=True,id=b8698723-2577-4f03-aa99-ea06a904c148,network=Network(3506bf24-d962-44d8-ae8b-5f10ebe7fa2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8698723-25') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:03:31.399964 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.401545 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8698723-25, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:31.405785 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Attempting a stable device rescue May 27 21:03:31.408100 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.409936 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:31.415129 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.422999 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.422999 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0c3bd95-b4fd-4a24-9e9e-a09d2b4bda63) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:31.422999 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.422999 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:31.430391 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.434101 np0000001553 nova-compute[98213]: INFO os_vif [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:ec:22,bridge_name='br-int',has_traffic_filtering=True,id=b8698723-2577-4f03-aa99-ea06a904c148,network=Network(3506bf24-d962-44d8-ae8b-5f10ebe7fa2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8698723-25') May 27 21:03:31.434406 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Deleting instance files /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943_del May 27 21:03:31.435386 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Deletion of /opt/stack/data/nova/instances/22e422c7-47a4-4619-92a8-b05b73989943_del complete May 27 21:03:31.439991 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.454786 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.459405 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.480569 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.520544 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:31.524292 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:31.524904 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece.part --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.561720 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.568267 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:03:31.568699 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.606204 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98213) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} May 27 21:03:31.610760 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Instance directory exists: not creating {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} May 27 21:03:31.610892 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Creating image(s) May 27 21:03:31.611636 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "/opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:31.611837 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:31.612966 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:31.613219 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:31.621722 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece.part --force-share --output=json" returned: 0 in 0.097s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.622237 np0000001553 nova-compute[98213]: DEBUG nova.virt.images [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] e25494d4-a649-4a75-ab22-12240ef97c22 was qcow2, converting to raw {{(pid=98213) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} May 27 21:03:31.622794 np0000001553 nova-compute[98213]: DEBUG nova.privsep.utils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98213) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} May 27 21:03:31.623074 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece.part /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece.converted {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.664113 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.664736 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.748717 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:31.752481 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.755331 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.765763 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece.part /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece.converted" returned: 0 in 0.142s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.771373 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece.converted --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.850286 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.854623 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.878907 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece.converted --force-share --output=json" returned: 0 in 0.106s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.879456 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "0187e0e2a7ad0e4262a85ccea59eac884f57dece" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.110s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:31.880286 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:31.883672 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:31.885046 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.937953 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.945104 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:03:31.946192 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:31.962396 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Took 1.49 seconds to destroy the instance on the hypervisor. May 27 21:03:31.967476 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:03:31.967854 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:03:31.968040 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:03:31.969010 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:31.977837 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece --force-share --output=json" returned: 0 in 0.093s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:31.978548 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "0187e0e2a7ad0e4262a85ccea59eac884f57dece" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:31.979353 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "0187e0e2a7ad0e4262a85ccea59eac884f57dece" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:31.980195 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:31.982756 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:31.983062 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:32.007110 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "env LANG=C uptime" returned: 0 in 0.060s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:32.008371 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Hypervisor/Node resource view: name=np0000001553 free_ram=11422MB free_disk=74.23504257202148GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98213) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} May 27 21:03:32.008772 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:32.067348 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece --force-share --output=json" returned: 0 in 0.083s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:32.067868 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece,backing_fmt=raw /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:32.088844 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:32.109401 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece,backing_fmt=raw /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk 1073741824" returned: 0 in 0.041s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:32.109919 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "0187e0e2a7ad0e4262a85ccea59eac884f57dece" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.130s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:32.110279 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:32.125014 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance<9992b23e-7582-49b6-977c-45dfc6f43ea3> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:32.128075 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "cbc713f48140a66fe54f1d7e748ac73f34c81fa0" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:32.131220 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "cbc713f48140a66fe54f1d7e748ac73f34c81fa0" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:32.215879 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0187e0e2a7ad0e4262a85ccea59eac884f57dece --force-share --output=json" returned: 0 in 0.105s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:32.216648 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:03:32.216648 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:32.322054 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:32.323610 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Cannot resize image /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:03:32.323610 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:03:32.323610 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Ensure instance console log exists: /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:03:32.324091 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:32.324483 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:32.324722 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:32.327250 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Start _get_guest_xml network_info=[{"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-27T20:58:46Z,direct_url=,disk_format='qcow2',id=e25494d4-a649-4a75-ab22-12240ef97c22,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-05-27T20:58:50Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a8b6e8af-99d6-4ab7-82c7-68af9f22c24f', 'attached_at': '', 'detached_at': '', 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'serial': '495837fb-9572-47a8-82af-4a6a5707f496'}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '19efdc6d-3137-41e6-908f-0b398f8679b1', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:03:32.332917 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError May 27 21:03:32.332917 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='e25494d4-a649-4a75-ab22-12240ef97c22', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1150672827', uuid='a8b6e8af-99d6-4ab7-82c7-68af9f22c24f'), owner=OwnerMeta(userid='99659c2947e743c899512883f5a85b0e', username='tempest-ServerActionsTestOtherA-113699651-project-member', projectid='b562b6a1ba2b4c3ab101af22f9d04713', projectname='tempest-ServerActionsTestOtherA-113699651'), image=ImageMeta(id='e25494d4-a649-4a75-ab22-12240ef97c22', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915812.3324518) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:03:32.334195 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:03:32.334494 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:03:32.337694 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:03:32.338153 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:03:32.339246 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:03:32.339689 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-27T20:58:46Z,direct_url=,disk_format='qcow2',id=e25494d4-a649-4a75-ab22-12240ef97c22,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-05-27T20:58:50Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:03:32.340113 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:03:32.340477 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:03:32.340477 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:03:32.340613 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:03:32.340743 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:03:32.340993 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:03:32.341162 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:03:32.341308 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:03:32.341438 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:03:32.341939 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:03:32.341939 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8b6e8af-99d6-4ab7-82c7-68af9f22c24f {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:32.362472 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:32.693943 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4978fc54-2211-461a-9f23-0045e775f368 req-7cb4ade2-ae10-4c53-bbff-5e0b2483efce service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Received event network-vif-deleted-b8698723-2577-4f03-aa99-ea06a904c148 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:32.694792 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-4978fc54-2211-461a-9f23-0045e775f368 req-7cb4ade2-ae10-4c53-bbff-5e0b2483efce service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Neutron deleted interface b8698723-2577-4f03-aa99-ea06a904c148; detaching it from the instance and deleting it from the info cache May 27 21:03:32.699085 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4978fc54-2211-461a-9f23-0045e775f368 req-7cb4ade2-ae10-4c53-bbff-5e0b2483efce service nova] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Detach interface failed, port_id=b8698723-2577-4f03-aa99-ea06a904c148, reason: Instance 22e422c7-47a4-4619-92a8-b05b73989943 could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:03:32.758877 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-1ee6a8b6-ddbe-47a3-990c-b895587aab4a req-a1c137c8-6cf0-48ae-bb45-210533b1ece8 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Received event network-vif-plugged-e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:32.759028 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-1ee6a8b6-ddbe-47a3-990c-b895587aab4a req-a1c137c8-6cf0-48ae-bb45-210533b1ece8 service nova] Acquiring lock "d92e4c8c-8850-42c6-b960-09e248044889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:32.759172 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-1ee6a8b6-ddbe-47a3-990c-b895587aab4a req-a1c137c8-6cf0-48ae-bb45-210533b1ece8 service nova] Lock "d92e4c8c-8850-42c6-b960-09e248044889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:32.759332 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-1ee6a8b6-ddbe-47a3-990c-b895587aab4a req-a1c137c8-6cf0-48ae-bb45-210533b1ece8 service nova] Lock "d92e4c8c-8850-42c6-b960-09e248044889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:32.760587 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-1ee6a8b6-ddbe-47a3-990c-b895587aab4a req-a1c137c8-6cf0-48ae-bb45-210533b1ece8 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Processing event network-vif-plugged-e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:03:32.760587 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:03:32.763101 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:32.763332 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d92e4c8c-8850-42c6-b960-09e248044889] VM Resumed (Lifecycle Event) May 27 21:03:32.766427 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:03:32.769223 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Instance spawned successfully. May 27 21:03:32.769633 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:03:32.826974 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:32.829410 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:32.830466 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0.part --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:32.865563 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:03:32.866293 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:32.866461 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:32.867109 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:32.867329 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:03:32.881572 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:32.882393 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:32.884179 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:32.884405 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:32.885462 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:32.885837 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:32.888170 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:32.888170 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:32.895602 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:32.895602 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:32.902540 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:32.902540 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:32.910081 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496] added May 27 21:03:32.910081 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:32.910081 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:32.910081 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:32.910081 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:32.910081 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:32.910081 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:32.910345 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:32.910525 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:32.910658 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:32.916997 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496] added May 27 21:03:32.916997 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:32.916997 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:32.916997 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:32.916997 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:32.916997 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:32.916997 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:32.917411 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:32.917690 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:32.917836 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:32.921548 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0.part --force-share --output=json" returned: 0 in 0.091s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:32.921854 np0000001553 nova-compute[98213]: DEBUG nova.virt.images [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] 5c90ffc8-53a8-4b16-85b0-23402aefbe53 was qcow2, converting to raw {{(pid=98213) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} May 27 21:03:32.923244 np0000001553 nova-compute[98213]: DEBUG nova.privsep.utils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98213) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} May 27 21:03:32.923560 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0.part /opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0.converted {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:33.004866 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0.part /opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0.converted" returned: 0 in 0.081s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:33.011085 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0.converted --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:33.106978 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0.converted --force-share --output=json" returned: 0 in 0.096s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:33.107919 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "cbc713f48140a66fe54f1d7e748ac73f34c81fa0" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.977s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:33.108585 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:33.109157 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:33.115412 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:33.116631 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "cbc713f48140a66fe54f1d7e748ac73f34c81fa0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:33.117155 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "cbc713f48140a66fe54f1d7e748ac73f34c81fa0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:33.117525 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:33.120365 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:33.120696 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0 --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:33.220876 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0 --force-share --output=json" returned: 0 in 0.100s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:33.221423 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0,backing_fmt=raw /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.rescue {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:33.269575 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:33.278811 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:33.285352 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:33.288165 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a526ea84-b4f5-4e5e-876c-932f0e8ae889 req-a7509ae4-6663-4207-b247-6b19a7e32b2e service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:33.288473 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a526ea84-b4f5-4e5e-876c-932f0e8ae889 req-a7509ae4-6663-4207-b247-6b19a7e32b2e service nova] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:33.288720 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a526ea84-b4f5-4e5e-876c-932f0e8ae889 req-a7509ae4-6663-4207-b247-6b19a7e32b2e service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:33.288901 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a526ea84-b4f5-4e5e-876c-932f0e8ae889 req-a7509ae4-6663-4207-b247-6b19a7e32b2e service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:33.289075 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a526ea84-b4f5-4e5e-876c-932f0e8ae889 req-a7509ae4-6663-4207-b247-6b19a7e32b2e service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Processing event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:03:33.289430 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbc713f48140a66fe54f1d7e748ac73f34c81fa0,backing_fmt=raw /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.rescue" returned: 0 in 0.065s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:33.289853 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:03:33.290629 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:33.291131 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "cbc713f48140a66fe54f1d7e748ac73f34c81fa0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.173s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:33.291456 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'migration_context' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:33.292324 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:33.292630 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:33.293450 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:33.297264 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:33.306923 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance running successfully. May 27 21:03:33.307361 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] finish_revert_migration finished successfully. {{(pid=98213) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}} May 27 21:03:33.393562 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:33.614732 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Took 1.65 seconds to deallocate network for instance. May 27 21:03:33.782387 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: d92e4c8c-8850-42c6-b960-09e248044889] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:03:33.782764 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:33.782764 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Resumed (Lifecycle Event) May 27 21:03:33.793645 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance<9992b23e-7582-49b6-977c-45dfc6f43ea3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:33.793951 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:03:33.794807 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Start _get_guest_xml network_info=[{"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "vif_mac": "fa:16:3e:df:78:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue={'image_id': '5c90ffc8-53a8-4b16-85b0-23402aefbe53', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, 'status': 'reserved', 'instance': '9992b23e-7582-49b6-977c-45dfc6f43ea3', 'attached_at': '', 'detached_at': '', 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'serial': '72582c17-9811-4887-aaf7-fa2d1fa07bda'}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '430b7db0-16f2-41fc-8a7d-15354f1dec4b', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:03:33.795379 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'resources' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:33.805762 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Took 10.58 seconds to spawn the instance on the hypervisor. May 27 21:03:33.806040 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:33.902103 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.056s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:33.902738 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:03:33.905498 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.897s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:33.911261 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:33.918392 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:33.933812 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:33.933812 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:33.933812 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:33.946328 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:33.946328 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:33.946328 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:33.946328 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:33.954720 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:33.965659 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:33.972133 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:33.972133 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:33.972133 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:33.972133 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:33.972133 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:33.972133 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:33.972133 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:33.972133 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:33.972133 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:33.972133 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:33.972598 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:33.972598 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:33.972598 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:33.972598 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:33.972598 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:33.972598 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:33.972598 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:33.972598 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:33.972598 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:33.972598 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:33.986675 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:33.986675 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:33.986675 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:33.986675 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:33.986675 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:33.986675 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:33.986675 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:33.986675 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:33.986675 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:33.986675 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:33.987108 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:33.987108 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:33.987108 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:33.987108 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:33.987108 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:33.987108 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:33.987108 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:33.987108 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:33.987108 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:33.987108 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:34.016748 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.40.100,3260] May 27 21:03:34.016748 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.40.100,3260] successful. May 27 21:03:34.016748 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:34.031660 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:34.040666 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.50.100,3260] May 27 21:03:34.040666 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.50.100,3260] successful. May 27 21:03:34.040666 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:34.050354 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:34.050354 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:34.050737 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:34.050737 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:34.051081 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:34.051081 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:34.051494 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:34.052994 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] HCTL ('11', '-', '-', 0) found on session 28 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:34.053135 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:34.069478 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching for a device in session 28 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:34.069478 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:34.073106 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:34.073106 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:34.073498 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:34.073498 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:34.073896 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:34.073896 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:34.074775 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] HCTL ('12', '-', '-', 0) found on session 29 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:34.074915 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:34.095608 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching for a device in session 29 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:34.095608 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:34.124918 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:34.289736 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:34.291218 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:34.297288 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance<9992b23e-7582-49b6-977c-45dfc6f43ea3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:34.299719 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:03:34.300904 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-505213430', uuid='9992b23e-7582-49b6-977c-45dfc6f43ea3'), owner=OwnerMeta(userid='18e30c231082464ab556592986d8b793', username='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member', projectid='79fe4bede0c741bfb93a23985eeef42e', projectname='tempest-ServerBootFromVolumeStableRescueTest-1106755838'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "vif_mac": "fa:16:3e:df:78:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915814.3005269) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:03:34.301627 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:03:34.301968 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:03:34.302710 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:03:34.302885 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:03:34.303747 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:03:34.304085 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:03:34.304241 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:03:34.304336 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:03:34.304505 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:03:34.304634 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:03:34.304840 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:03:34.304990 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:03:34.305094 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:03:34.305218 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:03:34.305332 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:03:34.305477 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:03:34.305687 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:34.318325 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Took 16.66 seconds to build instance. May 27 21:03:34.368158 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-391974f7-c74c-4748-8d09-4d6c0943d269 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating instance to original state: 'active' May 27 21:03:34.413160 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:03:34.416238 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:03:34.417444 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:34.417790 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:34.514588 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cd5dd7a0b5f4ebe92323cc3511400d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b2425358de4fce9300d2669de2fa0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:03:34.753086 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:34.754114 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:34.754114 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:34.754114 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:34.754114 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:34.754114 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received unexpected event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with vm_state active and task_state rescuing. May 27 21:03:34.754114 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:34.754114 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:34.754114 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:34.754114 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:34.754508 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:34.754508 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-7bf27d7c-24f6-45ba-bada-cf3da94fb2ac req-b5de08cf-6f99-4fb6-8b35-624693f365dc service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received unexpected event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with vm_state active and task_state rescuing. May 27 21:03:34.794005 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] During sync_power_state the instance has a pending task (resize_reverting). Skip. May 27 21:03:34.807851 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance<9992b23e-7582-49b6-977c-45dfc6f43ea3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:34.816742 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.config --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:34.830498 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0b9611d1-bf71-4458-88e3-40995007cf37 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "d92e4c8c-8850-42c6-b960-09e248044889" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.176s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:34.885280 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:03:34.908794 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.config --force-share --output=json" returned: 0 in 0.092s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:34.909755 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "/opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:34.909755 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:34.910057 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "/opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:34.910549 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:03:34.911744 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:34.912764 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:34.927720 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:03:34.957635 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Successfully created port: 569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:03:34.992442 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance f4397c41-4087-4367-b1ac-46e8cc475772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.992641 np0000001553 nova-compute[98213]: WARNING nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 22e422c7-47a4-4619-92a8-b05b73989943 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do. May 27 21:03:34.992780 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance f0c8ea02-9725-47ed-b34b-13ea3552d09b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.992913 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 1597a38f-a6a7-45bd-86ec-3938926c5cc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.993049 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.993281 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance a6108bdf-d518-447f-927d-43d7fa6456e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.993414 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 698b750b-959f-4358-b7a0-5f68e76f5a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.993541 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.993669 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance d61bda11-c563-480f-9f5f-7d85ef081cae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.993792 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 950bfe97-53fd-4086-bfa5-69ea3a75c088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.993912 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 9992b23e-7582-49b6-977c-45dfc6f43ea3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.994048 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 59971b35-cbb8-420e-a34e-b614819ad555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.994230 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance d92e4c8c-8850-42c6-b960-09e248044889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.994360 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 90152e6a-b6ed-44f4-a430-fed4fa027496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:03:34.994589 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} May 27 21:03:34.994757 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Final resource view: name=np0000001553 phys_ram=24030MB used_ram=3008MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 21:03:31 up 29 min, 2 users, load average: 10.12, 5.09, 2.31\n', 'num_instances': '13', 'num_vm_active': '11', 'num_task_None': '10', 'num_os_type_None': '13', 'num_proj_79fe4bede0c741bfb93a23985eeef42e': '4', 'io_workload': '2', 'num_proj_b562b6a1ba2b4c3ab101af22f9d04713': '2', 'num_proj_251237411f6e4bb49303c88852d6e9a1': '5', 'num_vm_resized': '1', 'num_task_resize_reverting': '1', 'num_proj_3811fd8e033640e18a7080fe0a65d975': '1', 'num_task_rebuild_spawning': '1', 'num_task_rescuing': '1', 'num_vm_building': '1', 'num_proj_c1b2425358de4fce9300d2669de2fa0c': '1'} {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} May 27 21:03:35.012174 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4b634ef8-1ba4-4c46-9eec-a29116fc7e9c req-62ba5533-7170-4b3c-9c41-62fb2335b34e service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Received event network-vif-plugged-e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:35.012677 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b634ef8-1ba4-4c46-9eec-a29116fc7e9c req-62ba5533-7170-4b3c-9c41-62fb2335b34e service nova] Acquiring lock "d92e4c8c-8850-42c6-b960-09e248044889-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:35.013106 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b634ef8-1ba4-4c46-9eec-a29116fc7e9c req-62ba5533-7170-4b3c-9c41-62fb2335b34e service nova] Lock "d92e4c8c-8850-42c6-b960-09e248044889-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:35.013261 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b634ef8-1ba4-4c46-9eec-a29116fc7e9c req-62ba5533-7170-4b3c-9c41-62fb2335b34e service nova] Lock "d92e4c8c-8850-42c6-b960-09e248044889-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:35.013392 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4b634ef8-1ba4-4c46-9eec-a29116fc7e9c req-62ba5533-7170-4b3c-9c41-62fb2335b34e service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] No waiting events found dispatching network-vif-plugged-e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:35.013548 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-4b634ef8-1ba4-4c46-9eec-a29116fc7e9c req-62ba5533-7170-4b3c-9c41-62fb2335b34e service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Received unexpected event network-vif-plugged-e2c88b36-e738-45b0-8280-cb54bfc3a4ea for instance with vm_state active and task_state None. May 27 21:03:35.360460 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e4c99969-3be1-4ca3-b6c2-2807ceed96d6 req-6cd2358a-e5f6-45c9-950b-6b1f8e4a7cd6 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:35.360780 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e4c99969-3be1-4ca3-b6c2-2807ceed96d6 req-6cd2358a-e5f6-45c9-950b-6b1f8e4a7cd6 service nova] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:35.360816 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e4c99969-3be1-4ca3-b6c2-2807ceed96d6 req-6cd2358a-e5f6-45c9-950b-6b1f8e4a7cd6 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:35.360935 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e4c99969-3be1-4ca3-b6c2-2807ceed96d6 req-6cd2358a-e5f6-45c9-950b-6b1f8e4a7cd6 service nova] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:35.361124 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e4c99969-3be1-4ca3-b6c2-2807ceed96d6 req-6cd2358a-e5f6-45c9-950b-6b1f8e4a7cd6 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] No waiting events found dispatching network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:35.361270 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-e4c99969-3be1-4ca3-b6c2-2807ceed96d6 req-6cd2358a-e5f6-45c9-950b-6b1f8e4a7cd6 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received unexpected event network-vif-plugged-8c501903-cc36-46d4-9ca9-87394e07d00c for instance with vm_state active and task_state None. May 27 21:03:35.433638 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:03:35.549173 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Successfully updated port: 569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:03:35.858491 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:35.858818 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:35.908170 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Found WWN 3300000009a7456fc for multipath device dm-4 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:03:35.908501 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:35.910562 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.997s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:35.910854 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '3300000009a7456fc', 'path': '/dev/dm-4', 'multipath_id': '3300000009a7456fc'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:35.910964 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009a7456fc', 'path': '/dev/dm-4', 'multipath_id': '3300000009a7456fc'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:03:35.911338 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:03:35.927769 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:35.928431 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:35.929310 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:35.929560 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:35.930024 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:35.930315 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:35.948654 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:35.948654 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:35.948654 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:35.959407 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:35.959407 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:35.959407 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:35.959407 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:35.968390 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:35.979609 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:36.001335 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:36.001335 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:36.001335 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:36.002036 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.072s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:36.002036 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:36.003077 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:36.003077 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:36.004018 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:36.004018 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:36.005184 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.076s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:36.005507 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] HCTL ('14', '0', '0', 0) found on session 22 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:36.005856 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:36.005856 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:36.006806 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] HCTL ('13', '0', '0', 0) found on session 21 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:36.007225 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:36.020685 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching for a device in session 21 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:36.020685 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:36.021727 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Searching for a device in session 22 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:36.021727 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:36.051752 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquiring lock "refresh_cache-90152e6a-b6ed-44f4-a430-fed4fa027496" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:36.051886 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquired lock "refresh_cache-90152e6a-b6ed-44f4-a430-fed4fa027496" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:36.052082 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:03:36.085689 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:36.085689 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:36.085689 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:36.085689 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:36.085689 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:36.088690 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Terminating instance May 27 21:03:36.361748 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:36.419794 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T21:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1815635338',display_name='tempest-ServerActionsTestOtherA-server-1150672827',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-tempest-common-compute-instance-1815635338',id=13,image_ref='e25494d4-a649-4a75-ab22-12240ef97c22',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhRyl/gHlTk3NR31kz1TMU4ugUtNRNhvt3/is5Ou9Gh8FfxeQaQSkn9eAA9+1tgiBOuvzlKK/vItMkljBAUDewfhHBGnxPq32YISNTcCVOesxqFgmJRR6kSx4SB246g4g==',key_name='tempest-keypair-1121332834',keypairs=,launch_index=0,launched_at=2026-05-27T21:02:30Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b562b6a1ba2b4c3ab101af22f9d04713',ramdisk_id='',reservation_id='r-mometahb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e25494d4-a649-4a75-ab22-12240ef97c22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-113699651',owner_user_name='tempest-ServerActionsTestOtherA-113699651-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99659c2947e743c899512883f5a85b0e',uuid=a8b6e8af-99d6-4ab7-82c7-68af9f22c24f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:03:36.420002 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converting VIF {"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:36.420621 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:36.422229 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.423557 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] End _get_guest_xml xml= May 27 21:03:36.423557 np0000001553 nova-compute[98213]: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f May 27 21:03:36.423557 np0000001553 nova-compute[98213]: instance-0000000d May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 196608 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 1 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-server-1150672827 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 2026-05-27 21:03:32 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 192 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 1 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 0 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 0 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 1 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: True May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: bare May 27 21:03:36.423557 np0000001553 nova-compute[98213]: qcow2 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 1 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 0 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: virtio May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-113699651-project-member May 27 21:03:36.423557 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-113699651 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:03:36.423557 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f May 27 21:03:36.423557 np0000001553 nova-compute[98213]: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f May 27 21:03:36.423557 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: hvm May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 128 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 1 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: Nehalem May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: 495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: May 27 21:03:36.423557 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:03:36.426748 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T21:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1815635338',display_name='tempest-ServerActionsTestOtherA-server-1150672827',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-tempest-common-compute-instance-1815635338',id=13,image_ref='e25494d4-a649-4a75-ab22-12240ef97c22',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhRyl/gHlTk3NR31kz1TMU4ugUtNRNhvt3/is5Ou9Gh8FfxeQaQSkn9eAA9+1tgiBOuvzlKK/vItMkljBAUDewfhHBGnxPq32YISNTcCVOesxqFgmJRR6kSx4SB246g4g==',key_name='tempest-keypair-1121332834',keypairs=,launch_index=0,launched_at=2026-05-27T21:02:30Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b562b6a1ba2b4c3ab101af22f9d04713',ramdisk_id='',reservation_id='r-mometahb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e25494d4-a649-4a75-ab22-12240ef97c22',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-113699651',owner_user_name='tempest-ServerActionsTestOtherA-113699651-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99659c2947e743c899512883f5a85b0e',uuid=a8b6e8af-99d6-4ab7-82c7-68af9f22c24f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:03:36.426748 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converting VIF {"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:36.426748 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:36.427868 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:03:36.427868 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:36.427868 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:03:36.427868 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.427868 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11f43bc6-9e1d-559e-ac28-3b1b84c93747', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:36.427868 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.428986 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:36.433644 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.435662 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.435854 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2dc1bc4-0c, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:36.436280 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2dc1bc4-0c, col_values=(('qos', UUID('1b09144c-2631-45d7-a4f3-cab4872ba3f7')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:36.436480 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2dc1bc4-0c, col_values=(('external_ids', {'iface-id': 'a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:72:07', 'vm-uuid': 'a8b6e8af-99d6-4ab7-82c7-68af9f22c24f'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:36.437268 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.439195 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:36.448402 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.449316 np0000001553 nova-compute[98213]: INFO os_vif [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') May 27 21:03:36.456940 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:03:36.458015 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:03:36.458220 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Creating image(s) May 27 21:03:36.461656 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquiring lock "/opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:36.462480 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "/opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:36.464006 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "/opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:36.464614 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:36.467751 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:36.469721 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:36.557732 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.088s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:36.558384 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:36.559402 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:36.561064 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:36.567036 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:36.567036 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:36.598242 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:03:36.647834 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.081s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:36.648524 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:36.664593 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.688589 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:03:36.693332 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.698403 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk 1073741824" returned: 0 in 0.050s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:36.698886 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.140s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:36.699271 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:36.727743 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.762518 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:36.789862 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.090s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:36.790244 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:03:36.790452 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:36.832617 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-changed-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:36.833298 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Refreshing instance network info cache due to event network-changed-bbe00ed4-45d2-4b31-a1c0-aadcf463da83. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:36.833511 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] Acquiring lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:36.833596 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] Acquired lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:36.833748 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Refreshing network info cache for port bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:36.871386 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Compute_service record updated for np0000001553:np0000001553 {{(pid=98213) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} May 27 21:03:36.871620 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.966s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:36.873025 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:03:36.873715 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.750s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:36.875171 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:36.879090 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:36.879384 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Cannot resize image /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:03:36.882160 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:03:36.882160 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Ensure instance console log exists: /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:03:36.882160 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:36.882160 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:36.882160 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:36.934031 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:03:36.955810 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:36.965734 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999645131999841 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:36.969108 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Instance destroyed successfully. May 27 21:03:36.969362 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Deleted allocations for instance 22e422c7-47a4-4619-92a8-b05b73989943 May 27 21:03:36.971790 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lazy-loading 'resources' on Instance uuid 950bfe97-53fd-4086-bfa5-69ea3a75c088 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:37.106823 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Updating instance_info_cache with network_info: [{"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:37.110054 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5d98ef68-c688-42d2-99c8-c8e70a28f6f8 req-707b8e45-7e44-466d-ab80-57f324833206 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received event network-changed-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:37.110621 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5d98ef68-c688-42d2-99c8-c8e70a28f6f8 req-707b8e45-7e44-466d-ab80-57f324833206 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Refreshing instance network info cache due to event network-changed-569be002-224f-4939-b790-b914c9dfe500. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:37.110717 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5d98ef68-c688-42d2-99c8-c8e70a28f6f8 req-707b8e45-7e44-466d-ab80-57f324833206 service nova] Acquiring lock "refresh_cache-90152e6a-b6ed-44f4-a430-fed4fa027496" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:37.336920 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:37.480167 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-636487866',display_name='tempest-ServerActionsTestOtherB-server-636487866',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serveractionstestotherb-server-636487866',id=9,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP37vEU7tk6IZLG6nGgYJrRWC1XysqG9qhj9f6Ts3gEcgfRgE2Kuebb5geAJYt0lQJDqjDBxoFON2pCBOOFgVRPjkb/YhHT2yjUMuBmc0jN1WzS2xreRxA0w+OzMqxnUwQ==',key_name='tempest-keypair-736936884',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:33Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='3811fd8e033640e18a7080fe0a65d975',ramdisk_id='',reservation_id='r-004tqvtx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1747713240',owner_user_name='tempest-ServerActionsTestOtherB-1747713240-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='606bde5cb68847cc8b7b2af092fc6bd6',uuid=950bfe97-53fd-4086-bfa5-69ea3a75c088,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:03:37.480167 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converting VIF {"id": "8c501903-cc36-46d4-9ca9-87394e07d00c", "address": "fa:16:3e:83:3a:d3", "network": {"id": "e701008f-24b6-401c-9014-7140489bc5b3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2030006956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3811fd8e033640e18a7080fe0a65d975", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c501903-cc", "ovs_interfaceid": "8c501903-cc36-46d4-9ca9-87394e07d00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:37.480641 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:37.480846 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:03:37.486634 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:37.486952 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c501903-cc, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:37.489371 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:37.498914 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:37.499965 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:37.500163 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4190bf51-292b-4c23-8b26-8b11fa9fc1d7) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:37.501288 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:37.511345 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:37.514367 np0000001553 nova-compute[98213]: INFO os_vif [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:3a:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c501903-cc36-46d4-9ca9-87394e07d00c,network=Network(e701008f-24b6-401c-9014-7140489bc5b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c501903-cc') May 27 21:03:37.515924 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:03:37.516508 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:37.516659 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:37.611447 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Releasing lock "refresh_cache-90152e6a-b6ed-44f4-a430-fed4fa027496" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:37.611762 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Instance network_info: |[{"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:03:37.612082 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5d98ef68-c688-42d2-99c8-c8e70a28f6f8 req-707b8e45-7e44-466d-ab80-57f324833206 service nova] Acquired lock "refresh_cache-90152e6a-b6ed-44f4-a430-fed4fa027496" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:37.613996 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Start _get_guest_xml network_info=[{"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:03:37.615858 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-5d98ef68-c688-42d2-99c8-c8e70a28f6f8 req-707b8e45-7e44-466d-ab80-57f324833206 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Refreshing network info cache for port 569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:37.618451 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:03:37.619738 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-651934177', uuid='90152e6a-b6ed-44f4-a430-fed4fa027496'), owner=OwnerMeta(userid='1cd5dd7a0b5f4ebe92323cc3511400d1', username='tempest-VolumesAdminNegativeTest-1133816629-project-member', projectid='c1b2425358de4fce9300d2669de2fa0c', projectname='tempest-VolumesAdminNegativeTest-1133816629'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915817.6193457) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:03:37.620612 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:03:37.621022 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:03:37.621834 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:03:37.622103 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:03:37.623375 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:03:37.623820 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:03:37.624054 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:03:37.624212 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:03:37.624399 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:03:37.624554 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:03:37.624715 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:03:37.624944 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:03:37.625124 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:03:37.625343 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:03:37.626107 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:03:37.626548 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:03:37.641162 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:37.645782 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-651934177',display_name='tempest-VolumesAdminNegativeTest-server-651934177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-volumesadminnegativetest-server-651934177',id=18,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1b2425358de4fce9300d2669de2fa0c',ramdisk_id='',reservation_id='r-6hxz01nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1133816629',owner_user_name='tempest-VolumesAdminNegativeTest-1133816629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:35Z,user_data=None,user_id='1cd5dd7a0b5f4ebe92323cc3511400d1',uuid=90152e6a-b6ed-44f4-a430-fed4fa027496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:03:37.646084 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Converting VIF {"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:37.646711 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:94:37,bridge_name='br-int',has_traffic_filtering=True,id=569be002-224f-4939-b790-b914c9dfe500,network=Network(94af1f6a-2523-4063-92c9-d67f794b8922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569be002-22') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:37.647315 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lazy-loading 'pci_devices' on Instance uuid 90152e6a-b6ed-44f4-a430-fed4fa027496 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:37.776013 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:37.776334 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:37.873843 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:37.874059 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:37.874298 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:03:37.874443 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98213) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} May 27 21:03:37.874690 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.78 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:03:37.950521 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Found WWN 330000000a02ec7e6 for multipath device dm-5 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:03:37.950928 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.042s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:37.951114 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000a02ec7e6', 'path': '/dev/dm-5', 'multipath_id': '330000000a02ec7e6'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:37.951286 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a02ec7e6', 'path': '/dev/dm-5', 'multipath_id': '330000000a02ec7e6'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:03:37.951868 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.435s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:37.952298 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '23f1203c-2f1d-487c-8874-bb9efa65e764', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:03:37.952727 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:03:37.981678 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b7d812e8-c20b-4c0a-8181-dbda13ddb98b tempest-ServerStableDeviceRescueTest-382424917 tempest-ServerStableDeviceRescueTest-382424917-project-member] Lock "22e422c7-47a4-4619-92a8-b05b73989943" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.026s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:37.983060 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:37.983060 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:37.983722 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753 (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: tcp: [27] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764 (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:37.983722 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:37.984380 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c9858f7-ec1a-4ab4-bd6b-f35af4a5f753', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '27'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:03:37.984534 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '26')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:37.986171 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:37.986816 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:37.987060 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:37.987234 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No VIF found with MAC fa:16:3e:74:72:07, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:37.987955 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Using config drive May 27 21:03:37.989616 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764', '27')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:37.991002 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Resulting device map defaultdict(. at 0x79ced0191760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'): ({'sdn'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:03:37.991247 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Removing multipathed devices sdn, sdm {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:03:37.991493 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Flush multipath device 330000000c5130650 {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:03:38.021603 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:03:38.055566 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:03:38.100666 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Checking to see if SCSI volumes sdn, sdm have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:03:38.100848 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] SCSI volumes sdn, sdm have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:03:38.102194 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Checking to see if device paths {'sdn', 'sdm'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:03:38.114063 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Device paths {'sdn', 'sdm'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:03:38.114929 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:03:38.116563 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-5d98ef68-c688-42d2-99c8-c8e70a28f6f8 req-707b8e45-7e44-466d-ab80-57f324833206 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:38.125711 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:38.153339 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] End _get_guest_xml xml= May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 90152e6a-b6ed-44f4-a430-fed4fa027496 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: instance-00000012 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 196608 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 1 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: tempest-VolumesAdminNegativeTest-server-651934177 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 2026-05-27 21:03:37 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 192 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 1 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 0 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 0 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 1 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: True May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: bare May 27 21:03:38.153339 np0000001553 nova-compute[98213]: qcow2 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 1 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 0 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: virtio May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: tempest-VolumesAdminNegativeTest-1133816629-project-member May 27 21:03:38.153339 np0000001553 nova-compute[98213]: tempest-VolumesAdminNegativeTest-1133816629 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:03:38.153339 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 90152e6a-b6ed-44f4-a430-fed4fa027496 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 90152e6a-b6ed-44f4-a430-fed4fa027496 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: hvm May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 128 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: 1 May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: Nehalem May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: May 27 21:03:38.153339 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:03:38.155132 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Preparing to wait for external event network-vif-plugged-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:03:38.155132 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquiring lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:38.155132 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:38.155132 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:38.155132 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-651934177',display_name='tempest-VolumesAdminNegativeTest-server-651934177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-volumesadminnegativetest-server-651934177',id=18,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1b2425358de4fce9300d2669de2fa0c',ramdisk_id='',reservation_id='r-6hxz01nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1133816629',owner_user_name='tempest-VolumesAdminNegativeTest-1133816629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:35Z,user_data=None,user_id='1cd5dd7a0b5f4ebe92323cc3511400d1',uuid=90152e6a-b6ed-44f4-a430-fed4fa027496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:03:38.155374 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Converting VIF {"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:38.155716 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:94:37,bridge_name='br-int',has_traffic_filtering=True,id=569be002-224f-4939-b790-b914c9dfe500,network=Network(94af1f6a-2523-4063-92c9-d67f794b8922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569be002-22') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:38.155846 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:94:37,bridge_name='br-int',has_traffic_filtering=True,id=569be002-224f-4939-b790-b914c9dfe500,network=Network(94af1f6a-2523-4063-92c9-d67f794b8922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569be002-22') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:03:38.156256 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:38.156719 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:38.157553 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:03:38.160181 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:38.160181 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3975212-6bb5-5e28-91f9-30e9940abf6c', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:38.160181 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:38.161021 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:38.170696 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] May 27 21:03:38.170696 np0000001553 nova-compute[98213]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.40.100,3260] successful. May 27 21:03:38.170696 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:38.174670 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:38.180377 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:38.181701 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap569be002-22, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:38.181701 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap569be002-22, col_values=(('qos', UUID('99bed850-badd-4d50-8bf7-8718e6c8a931')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:38.181701 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap569be002-22, col_values=(('external_ids', {'iface-id': '569be002-224f-4939-b790-b914c9dfe500', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:94:37', 'vm-uuid': '90152e6a-b6ed-44f4-a430-fed4fa027496'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:38.185494 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:38.201776 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:38.202300 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:38.205000 np0000001553 nova-compute[98213]: INFO os_vif [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:94:37,bridge_name='br-int',has_traffic_filtering=True,id=569be002-224f-4939-b790-b914c9dfe500,network=Network(94af1f6a-2523-4063-92c9-d67f794b8922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569be002-22') May 27 21:03:38.215745 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:38.255420 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] May 27 21:03:38.255420 np0000001553 nova-compute[98213]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-23f1203c-2f1d-487c-8874-bb9efa65e764, portal: 192.168.50.100,3260] successful. May 27 21:03:38.255420 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:38.271536 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updated VIF entry in instance network info cache for port bbe00ed4-45d2-4b31-a1c0-aadcf463da83. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:03:38.272182 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updating instance_info_cache with network_info: [{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:38.273831 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:38.273831 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:38.273831 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] <== disconnect_volume: return (757ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:38.274013 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:03:38.274516 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Deleting instance files /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088_del May 27 21:03:38.279477 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Deletion of /opt/stack/data/nova/instances/950bfe97-53fd-4086-bfa5-69ea3a75c088_del complete May 27 21:03:38.284454 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'flavor' on Instance uuid 59971b35-cbb8-420e-a34e-b614819ad555 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:38.422008 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:38.422278 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:38.462710 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-505213430',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-505213430',id=15,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:03:24Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-02pe6j7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:24Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=9992b23e-7582-49b6-977c-45dfc6f43ea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "vif_mac": "fa:16:3e:df:78:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:03:38.462927 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "vif_mac": "fa:16:3e:df:78:38"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:38.463416 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:78:38,bridge_name='br-int',has_traffic_filtering=True,id=ef5211c5-95b3-4091-804e-3e3da3b14d0b,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5211c5-95') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:38.463827 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'pci_devices' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:38.491171 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lazy-loading 'ec2_ids' on Instance uuid a8b6e8af-99d6-4ab7-82c7-68af9f22c24f {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:38.513259 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-5d98ef68-c688-42d2-99c8-c8e70a28f6f8 req-707b8e45-7e44-466d-ab80-57f324833206 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:38.648787 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-5d98ef68-c688-42d2-99c8-c8e70a28f6f8 req-707b8e45-7e44-466d-ab80-57f324833206 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Updated VIF entry in instance network info cache for port 569be002-224f-4939-b790-b914c9dfe500. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:03:38.649074 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-5d98ef68-c688-42d2-99c8-c8e70a28f6f8 req-707b8e45-7e44-466d-ab80-57f324833206 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Updating instance_info_cache with network_info: [{"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:38.774803 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] Releasing lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:38.774992 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Received event network-changed-e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:38.775112 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Refreshing instance network info cache due to event network-changed-e2c88b36-e738-45b0-8280-cb54bfc3a4ea. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:38.775278 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] Acquiring lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:38.775363 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] Acquired lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:38.775463 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Refreshing network info cache for port e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:38.797596 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Took 2.20 seconds to destroy the instance on the hypervisor. May 27 21:03:38.800815 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:03:38.801001 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:03:38.801104 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:03:38.801311 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:38.866801 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:38.926540 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:03:38.967239 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance<9992b23e-7582-49b6-977c-45dfc6f43ea3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:38.968753 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] End _get_guest_xml xml= May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 9992b23e-7582-49b6-977c-45dfc6f43ea3 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: instance-0000000f May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 196608 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 1 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-server-505213430 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 2026-05-27 21:03:34 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 192 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 1 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 0 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 0 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 1 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: True May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: bare May 27 21:03:38.968753 np0000001553 nova-compute[98213]: qcow2 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 1 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 0 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: ide May 27 21:03:38.968753 np0000001553 nova-compute[98213]: virtio May 27 21:03:38.968753 np0000001553 nova-compute[98213]: pc May 27 21:03:38.968753 np0000001553 nova-compute[98213]: virtio May 27 21:03:38.968753 np0000001553 nova-compute[98213]: virtio May 27 21:03:38.968753 np0000001553 nova-compute[98213]: virtio May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member May 27 21:03:38.968753 np0000001553 nova-compute[98213]: tempest-ServerBootFromVolumeStableRescueTest-1106755838 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:03:38.968753 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 9992b23e-7582-49b6-977c-45dfc6f43ea3 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 9992b23e-7582-49b6-977c-45dfc6f43ea3 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: hvm May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 128 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 1 May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: Nehalem May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: 72582c17-9811-4887-aaf7-fa2d1fa07bda May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: May 27 21:03:38.968753 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:03:38.972385 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Instance destroyed successfully. May 27 21:03:39.001181 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Object Instance lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:39.001293 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lazy-loading 'keypairs' on Instance uuid a8b6e8af-99d6-4ab7-82c7-68af9f22c24f {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:39.021829 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0009442450000278768 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:39.022288 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:39.022957 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:39.023053 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.201778756000067 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:39.023128 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.201697795999962 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:39.024003 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] VM Stopped (Lifecycle Event) May 27 21:03:39.151176 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5d98ef68-c688-42d2-99c8-c8e70a28f6f8 req-707b8e45-7e44-466d-ab80-57f324833206 service nova] Releasing lock "refresh_cache-90152e6a-b6ed-44f4-a430-fed4fa027496" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:39.280281 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:39.294636 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:39.489355 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:39.489575 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:39.496075 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:03:39.496075 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Claim successful on node np0000001553 May 27 21:03:39.504009 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Object Instance lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:39.507771 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError May 27 21:03:39.526237 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:39.530511 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 4 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:39.651960 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:39.716398 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Creating config drive at /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.config May 27 21:03:39.720798 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplny5ljlp {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:39.736762 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:39.736762 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:39.736762 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] No VIF found with MAC fa:16:3e:41:94:37, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:39.737510 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Using config drive May 27 21:03:39.777047 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplny5ljlp" returned: 0 in 0.056s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:39.848422 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Updated VIF entry in instance network info cache for port e2c88b36-e738-45b0-8280-cb54bfc3a4ea. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:03:39.849307 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Updating instance_info_cache with network_info: [{"id": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "address": "fa:16:3e:65:89:2c", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2c88b36-e7", "ovs_interfaceid": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:40.038691 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-212584cc-40cb-44da-aa9d-15b67bc138e8 tempest-VolumesAssistedSnapshotsTest-30557332 tempest-VolumesAssistedSnapshotsTest-30557332-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. May 27 21:03:40.085342 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-f3ce3129-0bdf-44a7-ad71-edf835ee3f47 req-895a7849-3194-4e16-8a53-9aefc1f34fe3 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Received event network-vif-deleted-8c501903-cc36-46d4-9ca9-87394e07d00c {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:40.088342 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-f3ce3129-0bdf-44a7-ad71-edf835ee3f47 req-895a7849-3194-4e16-8a53-9aefc1f34fe3 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Neutron deleted interface 8c501903-cc36-46d4-9ca9-87394e07d00c; detaching it from the instance and deleting it from the info cache May 27 21:03:40.089658 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-f3ce3129-0bdf-44a7-ad71-edf835ee3f47 req-895a7849-3194-4e16-8a53-9aefc1f34fe3 service nova] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Detach interface failed, port_id=8c501903-cc36-46d4-9ca9-87394e07d00c, reason: Instance 950bfe97-53fd-4086-bfa5-69ea3a75c088 could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:03:40.249124 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:40.253255 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:40.286653 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:40.351818 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aef408e5-ca8f-450b-91d2-598396e3dac6 req-bc4950c0-30ed-4aad-a9af-8161318d498a service nova] Releasing lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:40.379699 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:40.399166 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:40.399303 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:40.399581 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Attaching volume be08ca87-a220-43b1-a6c7-12e3d06fb4d3 to /dev/vdb May 27 21:03:40.420420 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Creating config drive at /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk.config May 27 21:03:40.425113 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjkm3tv9i {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:40.456795 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:40.463076 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:40.466651 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:40.473861 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:03:40.488012 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjkm3tv9i" returned: 0 in 0.063s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:40.491589 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:40.491589 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:40.491589 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:40.491589 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] No VIF found with MAC fa:16:3e:df:78:38, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:40.492475 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Using config drive May 27 21:03:40.500158 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:40.531933 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:40.537469 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:03:40.537720 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:03:40.553071 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:03:40.554374 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc', 'fe80::fc16:3eff:fead:5cb7', 'fe80::fc16:3eff:fe62:2ad4', 'fe80::fc16:3eff:fe65:892c', 'fe80::fc16:3eff:fe74:7207'] May 27 21:03:40.554489 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:03:40.554574 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:03:40.554779 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:40.554993 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updating existing volume attachment record: a1512133-0a29-48c8-9835-18b7abdc5bb5 {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:03:40.606541 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7a61052e-d056-4589-af6b-325de31c961e req-31829f35-beb0-4e0a-a902-a09d5885f70b service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:40.607827 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7a61052e-d056-4589-af6b-325de31c961e req-31829f35-beb0-4e0a-a902-a09d5885f70b service nova] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:40.608858 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7a61052e-d056-4589-af6b-325de31c961e req-31829f35-beb0-4e0a-a902-a09d5885f70b service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:40.608858 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7a61052e-d056-4589-af6b-325de31c961e req-31829f35-beb0-4e0a-a902-a09d5885f70b service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:40.608858 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7a61052e-d056-4589-af6b-325de31c961e req-31829f35-beb0-4e0a-a902-a09d5885f70b service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] No waiting events found dispatching network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:40.608858 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-7a61052e-d056-4589-af6b-325de31c961e req-31829f35-beb0-4e0a-a902-a09d5885f70b service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received unexpected event network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb for instance with vm_state active and task_state rebuild_spawning. May 27 21:03:40.993634 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:41.000078 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'ec2_ids' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:41.026318 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:41.031134 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:41.034544 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Took 2.23 seconds to deallocate network for instance. May 27 21:03:41.134020 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:41.147531 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:03:41.147908 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:41.148090 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:41.151210 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:41.154397 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:03:41.171082 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:41.172190 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:41.172621 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:41.173189 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:41.173715 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:41.174022 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:41.189813 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:41.189813 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:41.206372 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:03:41.206372 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:41.211092 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3] added May 27 21:03:41.211092 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:41.211092 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:41.211092 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:41.211092 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:41.211092 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:41.211092 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:41.211092 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:41.211092 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.037(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:41.211379 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:41.224793 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3] added May 27 21:03:41.224793 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:03:41.224793 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:41.224793 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:41.224793 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:03:41.224793 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:03:41.224793 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:41.225043 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:03:41.225310 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0524(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:03:41.225537 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:03:41.266840 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:41.266840 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] VM Resumed (Lifecycle Event) May 27 21:03:41.267509 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Instance event wait completed in 0 seconds for {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:03:41.267794 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:03:41.275159 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Instance spawned successfully. May 27 21:03:41.275577 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:03:41.341516 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:41.341516 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:41.409467 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:41.414992 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:41.418853 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:41.446302 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:41.448998 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:41.509796 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance<9992b23e-7582-49b6-977c-45dfc6f43ea3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:41.510228 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'keypairs' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:41.624347 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Took 0.59 seconds to detach 1 volumes for instance. May 27 21:03:41.765692 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:41.771555 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:41.775650 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:41.786580 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:41.786787 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:41.787198 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:41.788455 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:41.788455 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:41.788455 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:41.846707 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:41.966079 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:42.015272 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance<9992b23e-7582-49b6-977c-45dfc6f43ea3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:42.022335 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:42.133450 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:42.156763 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Creating config drive at /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.config.rescue May 27 21:03:42.161324 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp06y37p7s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:42.211935 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:42.217583 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp06y37p7s" returned: 0 in 0.056s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:42.223082 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:42.223082 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:42.223082 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:42.223082 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:42.226095 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:42.237235 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:42.253266 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:42.253266 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:42.253266 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:42.253266 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:42.262725 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:42.262725 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.262725 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:42.273741 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:42.280243 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. May 27 21:03:42.280443 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:42.280601 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] VM Started (Lifecycle Event) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:42.292436 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.292436 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:42.295866 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:42.302316 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3, portal: 192.168.50.100,3260] May 27 21:03:42.302316 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3, portal: 192.168.50.100,3260] successful. May 27 21:03:42.302316 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:42.321608 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:42.343779 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3, portal: 192.168.40.100,3260] May 27 21:03:42.343779 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3, portal: 192.168.40.100,3260] successful. May 27 21:03:42.343779 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:42.352756 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.352756 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.352756 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.352756 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.352756 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.352756 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:42.352756 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:42.352756 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.352756 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.352756 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.352756 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:42.353000 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.353000 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.353000 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.353000 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.353000 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.353000 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:42.353000 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:42.353000 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.353000 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.353000 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.353000 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:42.353563 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:42.353897 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:42.355664 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.866s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:42.356787 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:03:42.360321 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:42.363718 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.230s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:42.364530 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('15', '-', '-', 0) found on session 30 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:42.364697 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:42.396632 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:42.396632 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:42.396632 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:42.396632 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:42.396632 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:42.396632 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('16', '-', '-', 0) found on session 31 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:42.396632 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:42.396632 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 30 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:42.396632 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:42.415252 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 31 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:42.415507 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:42.696168 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-fbd2ded7-2917-423e-bee3-f4624575ebc5 req-fedaf417-40f9-4016-8442-f52a2b5ffecd service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:42.696572 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-fbd2ded7-2917-423e-bee3-f4624575ebc5 req-fedaf417-40f9-4016-8442-f52a2b5ffecd service nova] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:42.696572 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-fbd2ded7-2917-423e-bee3-f4624575ebc5 req-fedaf417-40f9-4016-8442-f52a2b5ffecd service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:42.696572 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-fbd2ded7-2917-423e-bee3-f4624575ebc5 req-fedaf417-40f9-4016-8442-f52a2b5ffecd service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:42.696756 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-fbd2ded7-2917-423e-bee3-f4624575ebc5 req-fedaf417-40f9-4016-8442-f52a2b5ffecd service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] No waiting events found dispatching network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:42.697065 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-fbd2ded7-2917-423e-bee3-f4624575ebc5 req-fedaf417-40f9-4016-8442-f52a2b5ffecd service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received unexpected event network-vif-plugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb for instance with vm_state active and task_state None. May 27 21:03:42.732322 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:42.760241 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:42.783694 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:42.791237 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:42.822175 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:42.852811 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:42.868443 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:03:42.868443 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:03:42.868443 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:42.868443 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:42.910339 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:42.912961 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:42.962268 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f824052f16e642148868fa2d1df1f3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d3d950b316142468c97cb18a90f7492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:03:42.970483 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4337473e-c94f-449a-91c6-cf9eab2d134e req-c01ba46b-1e91-4720-a1c6-d657621864a9 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:42.970483 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4337473e-c94f-449a-91c6-cf9eab2d134e req-c01ba46b-1e91-4720-a1c6-d657621864a9 service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:42.970701 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4337473e-c94f-449a-91c6-cf9eab2d134e req-c01ba46b-1e91-4720-a1c6-d657621864a9 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:42.970942 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4337473e-c94f-449a-91c6-cf9eab2d134e req-c01ba46b-1e91-4720-a1c6-d657621864a9 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:42.971042 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4337473e-c94f-449a-91c6-cf9eab2d134e req-c01ba46b-1e91-4720-a1c6-d657621864a9 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:42.971276 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-4337473e-c94f-449a-91c6-cf9eab2d134e req-c01ba46b-1e91-4720-a1c6-d657621864a9 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received unexpected event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with vm_state active and task_state rescuing. May 27 21:03:43.173518 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:03:43.182115 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:43.296465 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:43.296611 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] VM Started (Lifecycle Event) May 27 21:03:43.369658 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:03:43.413249 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:43.428077 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:43.428900 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:43.666132 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Successfully created port: 0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:03:43.750543 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-c40dfea5-bc49-409f-ae5f-5522d5cef3c4 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:43.799767 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:43.802628 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:43.802782 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] VM Paused (Lifecycle Event) May 27 21:03:43.873929 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:03:43.933180 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:44.167312 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Successfully updated port: 0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:03:44.196865 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Found WWN 33000000069317437 for multipath device dm-6 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:03:44.197185 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:44.197354 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '33000000069317437', 'path': '/dev/dm-6', 'multipath_id': '33000000069317437'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:44.197496 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000069317437', 'path': '/dev/dm-6', 'multipath_id': '33000000069317437'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:03:44.199638 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'flavor' on Instance uuid 59971b35-cbb8-420e-a34e-b614819ad555 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:44.305861 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:44.307135 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:44.445840 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.082s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:44.448226 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 1.624s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:44.448416 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98213) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} May 27 21:03:44.511674 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Deleted allocations for instance 950bfe97-53fd-4086-bfa5-69ea3a75c088 May 27 21:03:44.669331 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:44.669510 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquired lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:44.670221 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:03:44.702321 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Attempting to attach volume be08ca87-a220-43b1-a6c7-12e3d06fb4d3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:03:44.703284 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] attach device xml: May 27 21:03:44.703284 np0000001553 nova-compute[98213]: May 27 21:03:44.703284 np0000001553 nova-compute[98213]: May 27 21:03:44.703284 np0000001553 nova-compute[98213]: May 27 21:03:44.703284 np0000001553 nova-compute[98213]: May 27 21:03:44.703284 np0000001553 nova-compute[98213]: be08ca87-a220-43b1-a6c7-12e3d06fb4d3 May 27 21:03:44.703284 np0000001553 nova-compute[98213]: May 27 21:03:44.703284 np0000001553 nova-compute[98213]: May 27 21:03:44.703284 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:03:44.810034 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:03:44.810732 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for 9992b23e-7582-49b6-977c-45dfc6f43ea3 due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:03:44.810732 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:44.810732 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] VM Resumed (Lifecycle Event) May 27 21:03:44.882527 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:03:44.883780 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:03:44.886292 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Creating image(s) May 27 21:03:44.887024 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "/opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:44.887389 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "/opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:44.888092 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "/opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:44.889233 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:44.899130 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:44.900172 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:45.023417 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.123s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:45.026074 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:45.026074 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:45.026074 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:45.033435 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:45.035312 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:45.063946 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:45.064316 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:45.064578 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:45.064739 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:45.064905 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:45.065067 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received unexpected event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with vm_state rescued and task_state None. May 27 21:03:45.065553 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Received event network-changed-0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:45.065843 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Refreshing instance network info cache due to event network-changed-0d95369a-dc11-4881-9f34-e4f0b174327b. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:45.066063 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] Acquiring lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:45.137710 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.102s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:45.138155 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:45.195902 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk 1073741824" returned: 0 in 0.057s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:45.196366 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.172s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:45.196706 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:45.291345 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:45.292113 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:03:45.292235 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:45.320386 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:45.329700 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:03:45.333590 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:45.397167 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:45.397700 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Cannot resize image /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:03:45.398065 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:03:45.398422 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Ensure instance console log exists: /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:03:45.398725 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:45.399021 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:45.399187 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:45.464067 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f85520e-14b2-45ad-aeb9-b8fe86e8b67f tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.017s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:45.497136 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-652c06dc-0734-4385-b863-a29bb7bae08a req-dfa12dea-2740-4f86-9334-a3d4c694eac1 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received event network-vif-unplugged-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:45.497406 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-652c06dc-0734-4385-b863-a29bb7bae08a req-dfa12dea-2740-4f86-9334-a3d4c694eac1 service nova] Acquiring lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:45.497620 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-652c06dc-0734-4385-b863-a29bb7bae08a req-dfa12dea-2740-4f86-9334-a3d4c694eac1 service nova] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:45.497793 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-652c06dc-0734-4385-b863-a29bb7bae08a req-dfa12dea-2740-4f86-9334-a3d4c694eac1 service nova] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:45.498000 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-652c06dc-0734-4385-b863-a29bb7bae08a req-dfa12dea-2740-4f86-9334-a3d4c694eac1 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] No event matching network-vif-unplugged-569be002-224f-4939-b790-b914c9dfe500 in dict_keys([('network-vif-plugged', '569be002-224f-4939-b790-b914c9dfe500')]) {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} May 27 21:03:45.498207 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-652c06dc-0734-4385-b863-a29bb7bae08a req-dfa12dea-2740-4f86-9334-a3d4c694eac1 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received unexpected event network-vif-unplugged-569be002-224f-4939-b790-b914c9dfe500 for instance with vm_state building and task_state spawning. May 27 21:03:45.528025 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-dc7062a6-12fc-443e-8fd6-3e7df63b24c2 tempest-ServerActionsTestOtherB-1747713240 tempest-ServerActionsTestOtherB-1747713240-project-member] Lock "950bfe97-53fd-4086-bfa5-69ea3a75c088" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.443s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:45.595105 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:45.614989 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Unrescuing May 27 21:03:45.614989 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:45.614989 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquired lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:45.614989 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:03:45.813954 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Updating instance_info_cache with network_info: [{"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:45.837939 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] During sync_power_state the instance has a pending task (unrescuing). Skip. May 27 21:03:45.838284 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:45.838589 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] VM Started (Lifecycle Event) May 27 21:03:46.118119 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:46.225406 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004574130000492005 future=) was cancelled during its delay period, skipping {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:46.225545 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:46.225545 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=-8.78499999998894e-05 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:46.225708 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00023609400000168534 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:46.225768 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:46.225844 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.739417526999887 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:46.227742 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=5.739346305000026 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:46.227742 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:46.227742 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] VM Stopped (Lifecycle Event) May 27 21:03:46.316135 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Releasing lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:46.316471 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Instance network_info: |[{"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:03:46.317202 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] Acquired lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:46.318941 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Refreshing network info cache for port 0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:46.320469 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Start _get_guest_xml network_info=[{"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:03:46.325546 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:03:46.326900 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1684979265', uuid='c14c8d62-737e-4297-88bf-f9ee3cc16dfa'), owner=OwnerMeta(userid='f824052f16e642148868fa2d1df1f3db', username='tempest-TaggedAttachmentsTest-125489879-project-member', projectid='5d3d950b316142468c97cb18a90f7492', projectname='tempest-TaggedAttachmentsTest-125489879'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915826.326352) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:03:46.328593 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:03:46.329179 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:03:46.331393 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:03:46.331393 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:03:46.334202 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:03:46.334202 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:03:46.334202 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:03:46.334202 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:03:46.334202 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:03:46.334202 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:03:46.334202 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:03:46.334202 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:03:46.334864 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:03:46.334986 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:03:46.335089 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:03:46.335257 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:03:46.343740 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:46.362245 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:46.367602 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:46.377283 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1684979265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-device-tagging-server-1684979265',id=19,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABNarNLahDnng7/wSw1U6VJLJIZ1Fxfgc8+XlIMoOiZvjeGdsfxl/D5ByDbf+lIN+rOYuVHGWI9P2IXAYVEu/i/jFpvvcmq0kuMQuuhLXndBD8rPL3i0TKKC7m9cQx9hQ==',key_name='tempest-keypair-799556134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d3d950b316142468c97cb18a90f7492',ramdisk_id='',reservation_id='r-jflni0f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-125489879',owner_user_name='tempest-TaggedAttachmentsTest-125489879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f824052f16e642148868fa2d1df1f3db',uuid=c14c8d62-737e-4297-88bf-f9ee3cc16dfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:03:46.377283 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Converting VIF {"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:46.377283 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:8e:b1,bridge_name='br-int',has_traffic_filtering=True,id=0d95369a-dc11-4881-9f34-e4f0b174327b,network=Network(3c9d13a6-e4fd-4368-a23a-a4eb93c46fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d95369a-dc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:46.379310 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lazy-loading 'pci_devices' on Instance uuid c14c8d62-737e-4297-88bf-f9ee3cc16dfa {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:46.385398 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:46.385911 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:46.386044 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:46.386624 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No VIF found with MAC fa:16:3e:62:2a:d4, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:46.619351 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:46.729645 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-91031ad4-8844-4495-bbd5-9e7b2bcd7383 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: 22e422c7-47a4-4619-92a8-b05b73989943] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:46.770719 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:46.789163 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Updating instance_info_cache with network_info: [{"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:46.821168 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:46.870773 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] During sync_power_state the instance has a pending task (unrescuing). Skip. May 27 21:03:46.884297 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] End _get_guest_xml xml= May 27 21:03:46.884297 np0000001553 nova-compute[98213]: c14c8d62-737e-4297-88bf-f9ee3cc16dfa May 27 21:03:46.884297 np0000001553 nova-compute[98213]: instance-00000013 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 196608 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 1 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: tempest-device-tagging-server-1684979265 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 2026-05-27 21:03:46 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 192 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 1 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 0 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 0 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 1 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: True May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: bare May 27 21:03:46.884297 np0000001553 nova-compute[98213]: qcow2 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 1 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 0 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: virtio May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: tempest-TaggedAttachmentsTest-125489879-project-member May 27 21:03:46.884297 np0000001553 nova-compute[98213]: tempest-TaggedAttachmentsTest-125489879 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:03:46.884297 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: c14c8d62-737e-4297-88bf-f9ee3cc16dfa May 27 21:03:46.884297 np0000001553 nova-compute[98213]: c14c8d62-737e-4297-88bf-f9ee3cc16dfa May 27 21:03:46.884297 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: hvm May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 128 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: 1 May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: Nehalem May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: May 27 21:03:46.884297 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:03:46.886599 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Preparing to wait for external event network-vif-plugged-0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:03:46.886765 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:46.887037 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:46.887249 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:46.888122 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1684979265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-device-tagging-server-1684979265',id=19,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABNarNLahDnng7/wSw1U6VJLJIZ1Fxfgc8+XlIMoOiZvjeGdsfxl/D5ByDbf+lIN+rOYuVHGWI9P2IXAYVEu/i/jFpvvcmq0kuMQuuhLXndBD8rPL3i0TKKC7m9cQx9hQ==',key_name='tempest-keypair-799556134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d3d950b316142468c97cb18a90f7492',ramdisk_id='',reservation_id='r-jflni0f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-125489879',owner_user_name='tempest-TaggedAttachmentsTest-125489879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f824052f16e642148868fa2d1df1f3db',uuid=c14c8d62-737e-4297-88bf-f9ee3cc16dfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:03:46.888872 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Converting VIF {"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:46.890195 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:8e:b1,bridge_name='br-int',has_traffic_filtering=True,id=0d95369a-dc11-4881-9f34-e4f0b174327b,network=Network(3c9d13a6-e4fd-4368-a23a-a4eb93c46fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d95369a-dc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:46.890195 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:8e:b1,bridge_name='br-int',has_traffic_filtering=True,id=0d95369a-dc11-4881-9f34-e4f0b174327b,network=Network(3c9d13a6-e4fd-4368-a23a-a4eb93c46fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d95369a-dc') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:03:46.890304 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:46.890482 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:46.890726 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:03:46.896162 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:46.896353 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df5fe885-90cb-56a5-9f4c-6d0e3e31d352', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:46.898068 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:46.899572 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:46.900657 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:46.902621 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:46.902621 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d95369a-dc, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:46.903015 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d95369a-dc, col_values=(('qos', UUID('fb3c80e2-9bac-4af2-a177-5b6b6dd14a8d')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:46.903242 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d95369a-dc, col_values=(('external_ids', {'iface-id': '0d95369a-dc11-4881-9f34-e4f0b174327b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:8e:b1', 'vm-uuid': 'c14c8d62-737e-4297-88bf-f9ee3cc16dfa'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:46.904463 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:46.906003 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:46.912704 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:46.915580 np0000001553 nova-compute[98213]: INFO os_vif [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:8e:b1,bridge_name='br-int',has_traffic_filtering=True,id=0d95369a-dc11-4881-9f34-e4f0b174327b,network=Network(3c9d13a6-e4fd-4368-a23a-a4eb93c46fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d95369a-dc') May 27 21:03:47.268636 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:47.293756 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Releasing lock "refresh_cache-9992b23e-7582-49b6-977c-45dfc6f43ea3" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:47.293756 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'flavor' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:47.578242 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received event network-vif-plugged-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:47.579092 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] Acquiring lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:47.579365 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:47.579544 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:47.579726 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Processing event network-vif-plugged-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:03:47.579938 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received event network-vif-plugged-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:47.580192 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] Acquiring lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:47.580876 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:47.580876 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:47.581168 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] No waiting events found dispatching network-vif-plugged-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:47.581368 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-9bbf952b-f2cf-4e5f-9a92-50a865387bb5 req-d12503f9-897a-4452-a856-c9a331cd6b97 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received unexpected event network-vif-plugged-569be002-224f-4939-b790-b914c9dfe500 for instance with vm_state building and task_state spawning. May 27 21:03:47.581693 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:03:47.585572 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:47.585884 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] VM Resumed (Lifecycle Event) May 27 21:03:47.596516 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Updated VIF entry in instance network info cache for port 0d95369a-dc11-4881-9f34-e4f0b174327b. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:03:47.596870 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Updating instance_info_cache with network_info: [{"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:47.598260 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:03:47.601807 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Instance spawned successfully. May 27 21:03:47.602318 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:03:47.804758 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "d92e4c8c-8850-42c6-b960-09e248044889" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:47.807437 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "d92e4c8c-8850-42c6-b960-09e248044889" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:47.838616 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:47.842839 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:47.868898 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:47.963191 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e17f12dd-b9f3-447b-898b-505a17d888f6 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.562s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:48.052702 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:48.061974 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:48.094913 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:48.097889 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:48.102127 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-62f62ad2-86e0-46a2-85ce-03bed4359424 req-015a5cad-9142-4cb7-9cac-90c7ed02ef28 service nova] Releasing lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:48.116658 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:48.117362 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:48.117955 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:48.118386 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:48.118730 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:48.119043 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:48.128432 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-85b3d741-918c-4e61-ab1f-558e54e61b0f req-1ca62056-2657-41e3-9731-738dcbafacb0 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:48.129045 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-85b3d741-918c-4e61-ab1f-558e54e61b0f req-1ca62056-2657-41e3-9731-738dcbafacb0 service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:48.129294 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-85b3d741-918c-4e61-ab1f-558e54e61b0f req-1ca62056-2657-41e3-9731-738dcbafacb0 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:48.129417 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-85b3d741-918c-4e61-ab1f-558e54e61b0f req-1ca62056-2657-41e3-9731-738dcbafacb0 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:48.129559 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-85b3d741-918c-4e61-ab1f-558e54e61b0f req-1ca62056-2657-41e3-9731-738dcbafacb0 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:48.129708 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-85b3d741-918c-4e61-ab1f-558e54e61b0f req-1ca62056-2657-41e3-9731-738dcbafacb0 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received unexpected event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with vm_state rescued and task_state unrescuing. May 27 21:03:48.190174 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Instance destroyed successfully. May 27 21:03:48.190174 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'numa_topology' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:48.314290 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'flavor' on Instance uuid d92e4c8c-8850-42c6-b960-09e248044889 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:48.318591 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:48.434924 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:48.435056 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:48.435234 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] No VIF found with MAC fa:16:3e:d3:8e:b1, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:48.435681 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Using config drive May 27 21:03:48.603951 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:03:48.604295 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999808255000062 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:48.630542 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Took 12.17 seconds to spawn the instance on the hypervisor. May 27 21:03:48.632836 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:48.691602 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Object Instance<9992b23e-7582-49b6-977c-45dfc6f43ea3> lazy-loaded attributes: flavor,numa_topology {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:03:48.941978 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:49.088162 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Creating config drive at /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk.config May 27 21:03:49.093091 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplj3a9ot5 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:49.147639 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplj3a9ot5" returned: 0 in 0.054s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:49.148497 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Took 18.43 seconds to build instance. May 27 21:03:49.182516 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:49.191099 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:49.216886 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:49.320529 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "d92e4c8c-8850-42c6-b960-09e248044889" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.514s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:49.392517 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:49.399343 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:49.650046 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.952s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:49.791400 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:49.829434 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:49.829434 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:50.005124 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:50.008924 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:50.155584 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-82b189dd-bb29-4362-b8d6-8cfc880c04c8 req-10e1f12f-d025-441e-8504-97bdf570b292 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Received event network-vif-plugged-0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:50.155965 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-82b189dd-bb29-4362-b8d6-8cfc880c04c8 req-10e1f12f-d025-441e-8504-97bdf570b292 service nova] Acquiring lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:50.156173 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-82b189dd-bb29-4362-b8d6-8cfc880c04c8 req-10e1f12f-d025-441e-8504-97bdf570b292 service nova] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:50.156486 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-82b189dd-bb29-4362-b8d6-8cfc880c04c8 req-10e1f12f-d025-441e-8504-97bdf570b292 service nova] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:50.156486 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-82b189dd-bb29-4362-b8d6-8cfc880c04c8 req-10e1f12f-d025-441e-8504-97bdf570b292 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Processing event network-vif-plugged-0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:03:50.239623 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:50.239894 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:50.240149 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:50.240409 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:50.240668 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:50.245010 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received unexpected event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with vm_state rescued and task_state unrescuing. May 27 21:03:50.245010 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:50.245214 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:50.245458 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:50.245458 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:50.245567 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:50.246176 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received unexpected event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with vm_state rescued and task_state unrescuing. May 27 21:03:50.246176 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:50.246176 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:50.246287 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:50.246367 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:50.246518 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:50.246667 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-7af1c049-a200-43ce-b175-467aa1607a56 req-24d41ee2-a660-4b1b-a98f-ba2f3d8d9e8d service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received unexpected event network-vif-plugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with vm_state rescued and task_state unrescuing. May 27 21:03:50.270560 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:50.302259 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:50.404043 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:50.404186 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:50.527256 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "d92e4c8c-8850-42c6-b960-09e248044889" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:50.527256 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "d92e4c8c-8850-42c6-b960-09e248044889" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:50.527256 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Attaching volume be08ca87-a220-43b1-a6c7-12e3d06fb4d3 to /dev/vdb May 27 21:03:50.584065 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:50.602667 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:03:50.627022 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:50.661846 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for 9992b23e-7582-49b6-977c-45dfc6f43ea3 due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:03:50.661846 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:50.661846 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] VM Resumed (Lifecycle Event) May 27 21:03:50.671858 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-9fdf90d8-d8b6-48f0-a984-70a9e17b269c tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:50.696952 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:03:50.697526 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:03:50.724213 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:03:50.729162 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fede:c7fc', 'fe80::fc16:3eff:fead:5cb7', 'fe80::fc16:3eff:fe62:2ad4', 'fe80::fc16:3eff:fe65:892c', 'fe80::fc16:3eff:fe74:7207', 'fe80::fc16:3eff:fe41:9437', 'fe80::3c06:8cff:fe13:19c2', 'fe80::fc16:3eff:fedf:7838', 'fe80::fc16:3eff:fed3:8eb1', 'fe80::8c52:96ff:fe71:ef82'] May 27 21:03:50.731420 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:03:50.731692 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:03:50.731990 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:50.733231 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Updating existing volume attachment record: 8de7db71-d001-4c2d-af2d-94d02d473b35 {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:03:50.865869 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:03:50.871811 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:03:50.877609 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Instance spawned successfully. May 27 21:03:50.878779 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:03:50.906485 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:03:51.174042 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:51.175911 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:51.294574 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "a604ade1-7e60-40f5-a20e-f5047653b103" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:51.294833 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "a604ade1-7e60-40f5-a20e-f5047653b103" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:51.303534 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:03:51.303874 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:51.304000 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:51.304392 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:51.304622 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:03:51.321875 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:51.322613 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:51.323446 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:51.323669 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:03:51.324342 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:51.325354 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:51.341951 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:51.341951 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:51.341951 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:51.348941 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.state = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:03:51.348941 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:03:51.348941 np0000001553 nova-compute[98213]: # END RECORD May 27 21:03:51.348941 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:51.357219 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:51.365424 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:51.383363 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a910b0d-1ec3-468d-b8b5-23220e2dbb93 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:51.383363 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a910b0d-1ec3-468d-b8b5-23220e2dbb93 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:51.383363 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:51.386232 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:51.386439 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:51.387655 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('15', '0', '0', 0) found on session 30 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:51.388121 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:51.389671 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:51.389920 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:51.390674 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:51.391543 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:51.391939 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:51.392296 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:03:51.398671 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a910b0d-1ec3-468d-b8b5-23220e2dbb93 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:51.398671 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a910b0d-1ec3-468d-b8b5-23220e2dbb93 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:51.398671 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:51.400149 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.077s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:51.400344 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:03:51.401061 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 30 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:51.401760 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:51.402187 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('16', '0', '0', 0) found on session 31 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:03:51.402827 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:03:51.418506 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 31 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:03:51.418506 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:03:51.472622 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:51.472622 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:51.476718 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:03:51.476893 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Claim successful on node np0000001553 May 27 21:03:51.678813 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:51.678962 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] VM Started (Lifecycle Event) May 27 21:03:51.770797 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:51.802699 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:03:51.903317 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Took 7.02 seconds to spawn the instance on the hypervisor. May 27 21:03:51.903473 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:51.904976 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:51.965890 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005303750001530716 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:51.966002 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:51.966472 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:51.966761 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=11.637389670999937 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:51.966933 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] VM Stopped (Lifecycle Event) May 27 21:03:51.968477 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=11.635670618999939 future=) was cancelled while queued, skipping {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:51.968816 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:52.183517 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:52.187627 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:52.273902 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5d34151e-8e89-477a-b3ed-006e2506248d req-6b157f82-d77c-49f9-9c31-176c233a06ad service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Received event network-vif-plugged-0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:52.273902 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5d34151e-8e89-477a-b3ed-006e2506248d req-6b157f82-d77c-49f9-9c31-176c233a06ad service nova] Acquiring lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:52.273902 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5d34151e-8e89-477a-b3ed-006e2506248d req-6b157f82-d77c-49f9-9c31-176c233a06ad service nova] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:52.274257 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-5d34151e-8e89-477a-b3ed-006e2506248d req-6b157f82-d77c-49f9-9c31-176c233a06ad service nova] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:52.274257 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-5d34151e-8e89-477a-b3ed-006e2506248d req-6b157f82-d77c-49f9-9c31-176c233a06ad service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] No waiting events found dispatching network-vif-plugged-0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:52.274257 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-5d34151e-8e89-477a-b3ed-006e2506248d req-6b157f82-d77c-49f9-9c31-176c233a06ad service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Received unexpected event network-vif-plugged-0d95369a-dc11-4881-9f34-e4f0b174327b for instance with vm_state active and task_state None. May 27 21:03:52.324577 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:03:52.376474 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:52.416138 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Took 12.99 seconds to build instance. May 27 21:03:52.471931 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4b0e633d-8eb3-421a-9b22-15d2598c84b8 None None] [instance: 950bfe97-53fd-4086-bfa5-69ea3a75c088] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:52.542812 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Refreshing inventories for resource provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} May 27 21:03:52.624322 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Updating ProviderTree inventory for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} May 27 21:03:52.624907 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquiring lock "90152e6a-b6ed-44f4-a430-fed4fa027496" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:52.625166 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Updating inventory in ProviderTree for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} May 27 21:03:52.626633 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:52.627086 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquiring lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:52.627314 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:52.628562 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:52.631254 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Terminating instance May 27 21:03:52.689919 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Refreshing aggregate associations for resource provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804, aggregates: None {{(pid=98213) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} May 27 21:03:52.692903 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:52.693084 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] VM Started (Lifecycle Event) May 27 21:03:52.773597 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:52.773597 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:52.773597 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:52.773597 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:52.773597 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:52.775533 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Refreshing trait associations for resource provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SOUND_MODEL_SB16,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,HW_ARCH_X86_64,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOUND_MODEL_AC97,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_ARCH_S390X,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ARCH_PPC64LE,COMPUTE_ARCH_AARCH64,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ARCH_RISCV64,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOUND_MODEL_USB,COMPUTE_VIOMMU_MODEL_SMMUV3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_ARCH_X86_64,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_SOUND_MODEL_ICH9 {{(pid=98213) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} May 27 21:03:52.782052 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Terminating instance May 27 21:03:52.920928 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.498s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:53.136239 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:03:53.171969 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:53.177516 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:53.195513 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:53.200263 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:53.207104 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:53.235936 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:53.236482 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:53.289169 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:03:53.315843 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:53.319652 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:53.349313 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:53.353341 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Found WWN 33000000069317437 for multipath device dm-6 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:03:53.353341 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.048s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:53.353341 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== connect_volume: return (2049ms) {'type': 'block', 'scsi_wwn': '33000000069317437', 'path': '/dev/dm-6', 'multipath_id': '33000000069317437'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:53.353341 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000069317437', 'path': '/dev/dm-6', 'multipath_id': '33000000069317437'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:03:53.364578 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'flavor' on Instance uuid d92e4c8c-8850-42c6-b960-09e248044889 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:53.501485 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Instance destroyed successfully. May 27 21:03:53.502027 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lazy-loading 'resources' on Instance uuid 90152e6a-b6ed-44f4-a430-fed4fa027496 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:53.511565 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:53.523543 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:53.527756 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-82df43bf-1203-4a0d-9b7c-5990fefe7899 req-2951059e-734b-444e-b5f0-e56426976e98 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:53.527969 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-82df43bf-1203-4a0d-9b7c-5990fefe7899 req-2951059e-734b-444e-b5f0-e56426976e98 service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:53.528157 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-82df43bf-1203-4a0d-9b7c-5990fefe7899 req-2951059e-734b-444e-b5f0-e56426976e98 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:53.528490 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-82df43bf-1203-4a0d-9b7c-5990fefe7899 req-2951059e-734b-444e-b5f0-e56426976e98 service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:53.528641 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-82df43bf-1203-4a0d-9b7c-5990fefe7899 req-2951059e-734b-444e-b5f0-e56426976e98 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:53.528827 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-82df43bf-1203-4a0d-9b7c-5990fefe7899 req-2951059e-734b-444e-b5f0-e56426976e98 service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:03:53.621937 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Instance destroyed successfully. May 27 21:03:53.623277 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'resources' on Instance uuid 9992b23e-7582-49b6-977c-45dfc6f43ea3 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:53.706227 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:53.706227 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] VM Paused (Lifecycle Event) May 27 21:03:53.714117 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:53.714377 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:53.869417 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Attempting to attach volume be08ca87-a220-43b1-a6c7-12e3d06fb4d3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:03:53.870357 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] attach device xml: May 27 21:03:53.870357 np0000001553 nova-compute[98213]: May 27 21:03:53.870357 np0000001553 nova-compute[98213]: May 27 21:03:53.870357 np0000001553 nova-compute[98213]: May 27 21:03:53.870357 np0000001553 nova-compute[98213]: May 27 21:03:53.870357 np0000001553 nova-compute[98213]: be08ca87-a220-43b1-a6c7-12e3d06fb4d3 May 27 21:03:53.870357 np0000001553 nova-compute[98213]: May 27 21:03:53.870357 np0000001553 nova-compute[98213]: May 27 21:03:53.870357 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:03:54.006068 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-651934177',display_name='tempest-VolumesAdminNegativeTest-server-651934177',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-volumesadminnegativetest-server-651934177',id=18,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:03:48Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c1b2425358de4fce9300d2669de2fa0c',ramdisk_id='',reservation_id='r-6hxz01nb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1133816629',owner_user_name='tempest-VolumesAdminNegativeTest-1133816629-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:03:49Z,user_data=None,user_id='1cd5dd7a0b5f4ebe92323cc3511400d1',uuid=90152e6a-b6ed-44f4-a430-fed4fa027496,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:03:54.008160 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Converting VIF {"id": "569be002-224f-4939-b790-b914c9dfe500", "address": "fa:16:3e:41:94:37", "network": {"id": "94af1f6a-2523-4063-92c9-d67f794b8922", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1811778954-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c1b2425358de4fce9300d2669de2fa0c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap569be002-22", "ovs_interfaceid": "569be002-224f-4939-b790-b914c9dfe500", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:54.008160 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:94:37,bridge_name='br-int',has_traffic_filtering=True,id=569be002-224f-4939-b790-b914c9dfe500,network=Network(94af1f6a-2523-4063-92c9-d67f794b8922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569be002-22') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:54.008160 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:94:37,bridge_name='br-int',has_traffic_filtering=True,id=569be002-224f-4939-b790-b914c9dfe500,network=Network(94af1f6a-2523-4063-92c9-d67f794b8922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569be002-22') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:03:54.009182 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.009356 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap569be002-22, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:54.010246 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.010906 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:54.015892 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.016825 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.017933 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99bed850-badd-4d50-8bf7-8718e6c8a931) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:54.018040 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.018606 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:54.024063 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.026898 np0000001553 nova-compute[98213]: INFO os_vif [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:94:37,bridge_name='br-int',has_traffic_filtering=True,id=569be002-224f-4939-b790-b914c9dfe500,network=Network(94af1f6a-2523-4063-92c9-d67f794b8922),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap569be002-22') May 27 21:03:54.026898 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Deleting instance files /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496_del May 27 21:03:54.028334 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Deletion of /opt/stack/data/nova/instances/90152e6a-b6ed-44f4-a430-fed4fa027496_del complete May 27 21:03:54.125226 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-505213430',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-505213430',id=15,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:03:43Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-02pe6j7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:03:51Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=9992b23e-7582-49b6-977c-45dfc6f43ea3,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:03:54.125407 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "address": "fa:16:3e:df:78:38", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef5211c5-95", "ovs_interfaceid": "ef5211c5-95b3-4091-804e-3e3da3b14d0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:54.126022 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:78:38,bridge_name='br-int',has_traffic_filtering=True,id=ef5211c5-95b3-4091-804e-3e3da3b14d0b,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5211c5-95') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:54.126300 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:78:38,bridge_name='br-int',has_traffic_filtering=True,id=ef5211c5-95b3-4091-804e-3e3da3b14d0b,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5211c5-95') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:03:54.128413 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.128645 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef5211c5-95, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:54.133171 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.133171 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:54.133171 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.133171 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.133171 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9486ccb2-965a-4285-928b-7d45067e52be) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:54.133171 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.133585 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:54.134165 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:54.136240 np0000001553 nova-compute[98213]: INFO os_vif [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:78:38,bridge_name='br-int',has_traffic_filtering=True,id=ef5211c5-95b3-4091-804e-3e3da3b14d0b,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef5211c5-95') May 27 21:03:54.137442 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:03:54.137928 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:03:54.138115 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:03:54.140547 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:03:54.140547 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '72582c17-9811-4887-aaf7-fa2d1fa07bda', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:03:54.140547 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:03:54.174466 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a910b0d-1ec3-468d-b8b5-23220e2dbb93 (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:54.174466 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:03:54.176079 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a910b0d-1ec3-468d-b8b5-23220e2dbb93 (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:03:54.176079 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:03:54.176079 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a910b0d-1ec3-468d-b8b5-23220e2dbb93', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:03:54.176079 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '21')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:54.177094 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda', '22')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:03:54.180486 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Resulting device map defaultdict(. at 0x79ceb04a3600>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'): ({'sdi'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:03:54.180854 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Removing multipathed devices sdh, sdi {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:03:54.181176 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flush multipath device 330000000a02ec7e6 {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:03:54.209232 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:54.217057 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:54.224455 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:03:54.224604 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] VM Resumed (Lifecycle Event) May 27 21:03:54.230964 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:03:54.279948 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:03:54.326195 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:03:54.326435 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:03:54.329123 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:03:54.342799 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ff3a1361-8143-4e19-a030-1cd0382a2529 req-1896cd4f-4f1a-4c52-b9d3-b1c92a319a6e service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Received event network-changed-0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:54.342949 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ff3a1361-8143-4e19-a030-1cd0382a2529 req-1896cd4f-4f1a-4c52-b9d3-b1c92a319a6e service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Refreshing instance network info cache due to event network-changed-0d95369a-dc11-4881-9f34-e4f0b174327b. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:54.343123 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ff3a1361-8143-4e19-a030-1cd0382a2529 req-1896cd4f-4f1a-4c52-b9d3-b1c92a319a6e service nova] Acquiring lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:54.344100 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ff3a1361-8143-4e19-a030-1cd0382a2529 req-1896cd4f-4f1a-4c52-b9d3-b1c92a319a6e service nova] Acquired lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:54.344348 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-ff3a1361-8143-4e19-a030-1cd0382a2529 req-1896cd4f-4f1a-4c52-b9d3-b1c92a319a6e service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Refreshing network info cache for port 0d95369a-dc11-4881-9f34-e4f0b174327b {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:54.345969 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:03:54.346303 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:03:54.359370 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:54.394273 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda, portal: 192.168.40.100,3260] May 27 21:03:54.394273 np0000001553 nova-compute[98213]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda, portal: 192.168.40.100,3260] successful. May 27 21:03:54.394273 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:54.419349 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:54.429881 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:54.478033 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda, portal: 192.168.50.100,3260] May 27 21:03:54.478033 np0000001553 nova-compute[98213]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-72582c17-9811-4887-aaf7-fa2d1fa07bda, portal: 192.168.50.100,3260] successful. May 27 21:03:54.478033 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:54.496267 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:03:54.496516 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:03:54.496642 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] <== disconnect_volume: return (359ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:03:54.496799 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:03:54.497071 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Deleting instance files /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3_del May 27 21:03:54.497611 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Deletion of /opt/stack/data/nova/instances/9992b23e-7582-49b6-977c-45dfc6f43ea3_del complete May 27 21:03:54.535670 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Took 1.40 seconds to destroy the instance on the hypervisor. May 27 21:03:54.537260 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:03:54.537511 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:03:54.537622 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:03:54.537888 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:54.645583 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:54.726849 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.255s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:54.728300 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:03:54.730225 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:03:54.730755 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.352s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:54.737088 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4bbd2488-37de-4f65-8ac4-a131576ba54e req-47f63e4c-f027-428f-b284-83d3633b6ca4 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received event network-vif-unplugged-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:54.737417 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4bbd2488-37de-4f65-8ac4-a131576ba54e req-47f63e4c-f027-428f-b284-83d3633b6ca4 service nova] Acquiring lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:54.737606 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4bbd2488-37de-4f65-8ac4-a131576ba54e req-47f63e4c-f027-428f-b284-83d3633b6ca4 service nova] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:54.737766 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4bbd2488-37de-4f65-8ac4-a131576ba54e req-47f63e4c-f027-428f-b284-83d3633b6ca4 service nova] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:54.737905 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4bbd2488-37de-4f65-8ac4-a131576ba54e req-47f63e4c-f027-428f-b284-83d3633b6ca4 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] No waiting events found dispatching network-vif-unplugged-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:54.739166 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4bbd2488-37de-4f65-8ac4-a131576ba54e req-47f63e4c-f027-428f-b284-83d3633b6ca4 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received event network-vif-unplugged-569be002-224f-4939-b790-b914c9dfe500 for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:03:54.739774 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:03:54.745222 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:03:54.746052 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Claim successful on node np0000001553 May 27 21:03:54.850177 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-ff3a1361-8143-4e19-a030-1cd0382a2529 req-1896cd4f-4f1a-4c52-b9d3-b1c92a319a6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:55.003338 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Took 1.72 seconds to destroy the instance on the hypervisor. May 27 21:03:55.004029 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:03:55.004202 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:03:55.004295 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:03:55.004522 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:55.089735 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:55.220315 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-ff3a1361-8143-4e19-a030-1cd0382a2529 req-1896cd4f-4f1a-4c52-b9d3-b1c92a319a6e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:55.234585 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:03:55.234917 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:03:55.235133 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:55.235352 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:55.257170 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999744988000202 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:55.257170 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999890226999923 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:55.257170 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998655191000125 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:55.257170 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998494564000111 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:03:55.320850 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc3a4342c86f437986a3c05ea178bec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acfdacf68cd433a94e1b4e91cfc6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:03:55.393374 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-ff3a1361-8143-4e19-a030-1cd0382a2529 req-1896cd4f-4f1a-4c52-b9d3-b1c92a319a6e service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Updated VIF entry in instance network info cache for port 0d95369a-dc11-4881-9f34-e4f0b174327b. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:03:55.393883 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-ff3a1361-8143-4e19-a030-1cd0382a2529 req-1896cd4f-4f1a-4c52-b9d3-b1c92a319a6e service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Updating instance_info_cache with network_info: [{"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:55.489474 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:55.536804 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:55.536919 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:55.537015 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:03:55.537107 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No VIF found with MAC fa:16:3e:65:89:2c, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:03:55.595342 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b0d6c784-991b-4371-a066-f2b64e37292a req-e9783709-7689-4ba6-91f6-64140029017e service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:55.595553 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b0d6c784-991b-4371-a066-f2b64e37292a req-e9783709-7689-4ba6-91f6-64140029017e service nova] Acquiring lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:55.596065 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b0d6c784-991b-4371-a066-f2b64e37292a req-e9783709-7689-4ba6-91f6-64140029017e service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:55.597770 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b0d6c784-991b-4371-a066-f2b64e37292a req-e9783709-7689-4ba6-91f6-64140029017e service nova] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:55.599409 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b0d6c784-991b-4371-a066-f2b64e37292a req-e9783709-7689-4ba6-91f6-64140029017e service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] No waiting events found dispatching network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:55.599625 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b0d6c784-991b-4371-a066-f2b64e37292a req-e9783709-7689-4ba6-91f6-64140029017e service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-unplugged-ef5211c5-95b3-4091-804e-3e3da3b14d0b for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:03:55.600031 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b0d6c784-991b-4371-a066-f2b64e37292a req-e9783709-7689-4ba6-91f6-64140029017e service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Received event network-vif-deleted-ef5211c5-95b3-4091-804e-3e3da3b14d0b {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:55.600117 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-b0d6c784-991b-4371-a066-f2b64e37292a req-e9783709-7689-4ba6-91f6-64140029017e service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Neutron deleted interface ef5211c5-95b3-4091-804e-3e3da3b14d0b; detaching it from the instance and deleting it from the info cache May 27 21:03:55.601356 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b0d6c784-991b-4371-a066-f2b64e37292a req-e9783709-7689-4ba6-91f6-64140029017e service nova] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Detach interface failed, port_id=ef5211c5-95b3-4091-804e-3e3da3b14d0b, reason: Instance 9992b23e-7582-49b6-977c-45dfc6f43ea3 could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:03:55.738311 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:03:55.816312 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Successfully created port: c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:03:55.869462 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:55.896099 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ff3a1361-8143-4e19-a030-1cd0382a2529 req-1896cd4f-4f1a-4c52-b9d3-b1c92a319a6e service nova] Releasing lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:55.991422 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Took 1.45 seconds to deallocate network for instance. May 27 21:03:56.245481 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:03:56.374566 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Took 1.37 seconds to deallocate network for instance. May 27 21:03:56.479595 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Successfully updated port: c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:03:56.504600 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:56.556924 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:56.557111 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:56.775305 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:56.822223 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4956036a-4b40-45ca-b375-5a729a4c2e3f req-980272af-e138-4396-87d6-5dd359c5a128 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received event network-vif-unplugged-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:56.822391 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4956036a-4b40-45ca-b375-5a729a4c2e3f req-980272af-e138-4396-87d6-5dd359c5a128 service nova] Acquiring lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:56.822754 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4956036a-4b40-45ca-b375-5a729a4c2e3f req-980272af-e138-4396-87d6-5dd359c5a128 service nova] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:56.822873 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4956036a-4b40-45ca-b375-5a729a4c2e3f req-980272af-e138-4396-87d6-5dd359c5a128 service nova] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:56.822991 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4956036a-4b40-45ca-b375-5a729a4c2e3f req-980272af-e138-4396-87d6-5dd359c5a128 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] No waiting events found dispatching network-vif-unplugged-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:03:56.823097 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-4956036a-4b40-45ca-b375-5a729a4c2e3f req-980272af-e138-4396-87d6-5dd359c5a128 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received unexpected event network-vif-unplugged-569be002-224f-4939-b790-b914c9dfe500 for instance with vm_state deleted and task_state None. May 27 21:03:56.823226 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4956036a-4b40-45ca-b375-5a729a4c2e3f req-980272af-e138-4396-87d6-5dd359c5a128 service nova] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Received event network-vif-deleted-569be002-224f-4939-b790-b914c9dfe500 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:56.960775 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Took 0.59 seconds to detach 1 volumes for instance. May 27 21:03:56.964394 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Deleting volume: 72582c17-9811-4887-aaf7-fa2d1fa07bda {{(pid=98213) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} May 27 21:03:56.981596 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:56.981749 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquired lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:56.981834 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:03:57.059905 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:57.102209 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-3f8d8c76-8fc0-4e75-8f3e-8a1f2a9863ac tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "d92e4c8c-8850-42c6-b960-09e248044889" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.577s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:57.256336 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:03:57.256336 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:03:57.256736 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Creating image(s) May 27 21:03:57.256910 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "/opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:57.257339 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "/opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:57.257466 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "/opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:57.257942 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:57.261576 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:57.263126 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:57.342205 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.079s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:57.342608 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:57.343036 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:57.343483 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:57.345881 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:03:57.346182 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:57.426112 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.079s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:57.427629 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:57.495162 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk 1073741824" returned: 0 in 0.067s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:57.495424 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.152s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:57.495759 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:57.531526 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:57.567439 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.840s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:57.567912 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:03:57.571298 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.067s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:57.585273 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.089s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:57.586202 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:03:57.586743 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:03:57.620775 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:03:57.689431 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:03:57.689886 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Cannot resize image /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:03:57.690296 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:03:57.690487 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Ensure instance console log exists: /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:03:57.690776 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:57.690991 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:57.691125 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:57.715040 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-40f6303a-5331-402b-a826-a7d7ac3b8b67 req-adc0d8ed-c3bc-46be-8ee6-5a6e4e5b2159 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-changed-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:57.718182 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-40f6303a-5331-402b-a826-a7d7ac3b8b67 req-adc0d8ed-c3bc-46be-8ee6-5a6e4e5b2159 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Refreshing instance network info cache due to event network-changed-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:57.718182 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-40f6303a-5331-402b-a826-a7d7ac3b8b67 req-adc0d8ed-c3bc-46be-8ee6-5a6e4e5b2159 service nova] Acquiring lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:57.887529 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:58.069393 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Updating instance_info_cache with network_info: [{"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:58.079114 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:03:58.080130 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:03:58.080480 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:58.080782 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:58.185266 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc3a4342c86f437986a3c05ea178bec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acfdacf68cd433a94e1b4e91cfc6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:03:58.543344 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:03:58.543887 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:03:58.583630 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Releasing lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:03:58.583630 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Instance network_info: |[{"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:03:58.583630 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Start _get_guest_xml network_info=[{"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:03:58.583630 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:03:58.586356 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-40f6303a-5331-402b-a826-a7d7ac3b8b67 req-adc0d8ed-c3bc-46be-8ee6-5a6e4e5b2159 service nova] Acquired lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:58.587596 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-40f6303a-5331-402b-a826-a7d7ac3b8b67 req-adc0d8ed-c3bc-46be-8ee6-5a6e4e5b2159 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Refreshing network info cache for port c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:58.590210 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:03:58.591577 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-470319356', uuid='28fe4f34-f07e-4eef-bc7e-59ad5d8adfef'), owner=OwnerMeta(userid='bc3a4342c86f437986a3c05ea178bec8', username='tempest-ServerRescueNegativeTestJSON-1361072921-project-member', projectid='1acfdacf68cd433a94e1b4e91cfc6ffc', projectname='tempest-ServerRescueNegativeTestJSON-1361072921'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915838.5911906) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:03:58.593805 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:03:58.594405 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:03:58.594909 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:03:58.595105 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:03:58.595981 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:03:58.596319 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:03:58.596450 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:03:58.596537 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:03:58.596650 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:03:58.596762 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:03:58.596854 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:03:58.597018 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:03:58.597118 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:03:58.597253 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:03:58.597374 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:03:58.597461 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:03:58.616560 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-470319356',display_name='tempest-ServerRescueNegativeTestJSON-server-470319356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverrescuenegativetestjson-server-470319356',id=20,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1acfdacf68cd433a94e1b4e91cfc6ffc',ramdisk_id='',reservation_id='r-6h61m9yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1361072921',owner_user_name='tempest-ServerRescueNegativeTestJSON-1361072921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:56Z,user_data=None,user_id='bc3a4342c86f437986a3c05ea178bec8',uuid=28fe4f34-f07e-4eef-bc7e-59ad5d8adfef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:03:58.616873 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converting VIF {"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:58.617397 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:44:d9,bridge_name='br-int',has_traffic_filtering=True,id=c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fb2ba7-dd') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:58.617819 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'pci_devices' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:03:58.745600 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Successfully created port: 186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:03:58.751390 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Stashing vm_state: active {{(pid=98213) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} May 27 21:03:59.046550 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:03:59.090385 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:03:59.097800 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-40f6303a-5331-402b-a826-a7d7ac3b8b67 req-adc0d8ed-c3bc-46be-8ee6-5a6e4e5b2159 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:59.121733 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] End _get_guest_xml xml= May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef May 27 21:03:59.121733 np0000001553 nova-compute[98213]: instance-00000014 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 196608 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 1 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-server-470319356 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 2026-05-27 21:03:58 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 192 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 1 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 0 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 0 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 1 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: True May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: bare May 27 21:03:59.121733 np0000001553 nova-compute[98213]: qcow2 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 1 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 0 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: virtio May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-1361072921-project-member May 27 21:03:59.121733 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-1361072921 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:03:59.121733 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef May 27 21:03:59.121733 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: hvm May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 128 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: 1 May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: Nehalem May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: May 27 21:03:59.121733 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:03:59.124558 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Preparing to wait for external event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:03:59.124558 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:59.124853 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:59.125073 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:59.125751 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-470319356',display_name='tempest-ServerRescueNegativeTestJSON-server-470319356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverrescuenegativetestjson-server-470319356',id=20,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1acfdacf68cd433a94e1b4e91cfc6ffc',ramdisk_id='',reservation_id='r-6h61m9yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1361072921',owner_user_name='tempest-ServerRescueNegativeTestJSON-1361072921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:56Z,user_data=None,user_id='bc3a4342c86f437986a3c05ea178bec8',uuid=28fe4f34-f07e-4eef-bc7e-59ad5d8adfef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:03:59.125878 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converting VIF {"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:03:59.126381 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:44:d9,bridge_name='br-int',has_traffic_filtering=True,id=c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fb2ba7-dd') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:03:59.126600 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:44:d9,bridge_name='br-int',has_traffic_filtering=True,id=c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fb2ba7-dd') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:03:59.126912 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:59.127207 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:59.127465 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:03:59.128344 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:59.128501 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b715668d-31ae-5345-b76f-8c5015ec27ef', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:59.129322 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:59.130347 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:59.131444 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:59.134490 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:59.134645 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2fb2ba7-dd, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:59.135002 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2fb2ba7-dd, col_values=(('qos', UUID('4a382600-750d-4302-ab4a-499137f7b988')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:59.135163 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2fb2ba7-dd, col_values=(('external_ids', {'iface-id': 'c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:44:d9', 'vm-uuid': '28fe4f34-f07e-4eef-bc7e-59ad5d8adfef'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:03:59.136776 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:59.137418 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:03:59.142970 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:03:59.144429 np0000001553 nova-compute[98213]: INFO os_vif [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:44:d9,bridge_name='br-int',has_traffic_filtering=True,id=c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fb2ba7-dd') May 27 21:03:59.332025 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:03:59.424793 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Successfully updated port: 186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:03:59.528769 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-40f6303a-5331-402b-a826-a7d7ac3b8b67 req-adc0d8ed-c3bc-46be-8ee6-5a6e4e5b2159 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:03:59.556358 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.985s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:03:59.558697 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.026s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:03:59.643804 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Deleted allocations for instance 90152e6a-b6ed-44f4-a430-fed4fa027496 May 27 21:03:59.741046 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-40f6303a-5331-402b-a826-a7d7ac3b8b67 req-adc0d8ed-c3bc-46be-8ee6-5a6e4e5b2159 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Updated VIF entry in instance network info cache for port c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:03:59.741372 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-40f6303a-5331-402b-a826-a7d7ac3b8b67 req-adc0d8ed-c3bc-46be-8ee6-5a6e4e5b2159 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Updating instance_info_cache with network_info: [{"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:03:59.760211 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b29d177b-f3a7-4520-9d42-9c12b9ca72f0 req-7eaf013a-f985-4dbe-8a87-2b392103ac01 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received event network-changed-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:03:59.760581 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-b29d177b-f3a7-4520-9d42-9c12b9ca72f0 req-7eaf013a-f985-4dbe-8a87-2b392103ac01 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Refreshing instance network info cache due to event network-changed-186fdbd5-b446-44a8-946a-f7b66d257204. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:03:59.760752 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b29d177b-f3a7-4520-9d42-9c12b9ca72f0 req-7eaf013a-f985-4dbe-8a87-2b392103ac01 service nova] Acquiring lock "refresh_cache-a604ade1-7e60-40f5-a20e-f5047653b103" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:03:59.760839 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b29d177b-f3a7-4520-9d42-9c12b9ca72f0 req-7eaf013a-f985-4dbe-8a87-2b392103ac01 service nova] Acquired lock "refresh_cache-a604ade1-7e60-40f5-a20e-f5047653b103" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:03:59.760935 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-b29d177b-f3a7-4520-9d42-9c12b9ca72f0 req-7eaf013a-f985-4dbe-8a87-2b392103ac01 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Refreshing network info cache for port 186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:03:59.920825 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "refresh_cache-a604ade1-7e60-40f5-a20e-f5047653b103" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:00.101432 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:04:00.102480 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:04:00.102767 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Creating image(s) May 27 21:04:00.103261 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "/opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:00.103470 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "/opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:00.103981 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "/opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:00.104645 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:00.107830 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:00.108743 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:00.206913 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.098s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:00.207815 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:00.211003 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:00.211527 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:00.214464 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:00.214810 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:00.245906 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-40f6303a-5331-402b-a826-a7d7ac3b8b67 req-adc0d8ed-c3bc-46be-8ee6-5a6e4e5b2159 service nova] Releasing lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:00.265369 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-b29d177b-f3a7-4520-9d42-9c12b9ca72f0 req-7eaf013a-f985-4dbe-8a87-2b392103ac01 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:00.309376 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:00.309999 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:00.361580 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk 1073741824" returned: 0 in 0.051s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:00.362222 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.151s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:00.362620 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:00.415044 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-b29d177b-f3a7-4520-9d42-9c12b9ca72f0 req-7eaf013a-f985-4dbe-8a87-2b392103ac01 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:04:00.486510 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.124s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:00.486965 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:04:00.487289 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:00.509461 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:00.509804 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:00.585302 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:00.585757 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Cannot resize image /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:04:00.586192 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:04:00.586192 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Ensure instance console log exists: /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:04:00.586854 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:00.586854 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:00.586854 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:00.609242 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-b29d177b-f3a7-4520-9d42-9c12b9ca72f0 req-7eaf013a-f985-4dbe-8a87-2b392103ac01 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:00.662594 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-4eb4f53f-c11a-4e14-b326-4a9fcbe6fcd0 tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Lock "90152e6a-b6ed-44f4-a430-fed4fa027496" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.037s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:00.672244 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:00.672480 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:00.672602 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No VIF found with MAC fa:16:3e:be:44:d9, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:00.673308 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Using config drive May 27 21:04:01.020981 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:01.111662 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-b29d177b-f3a7-4520-9d42-9c12b9ca72f0 req-7eaf013a-f985-4dbe-8a87-2b392103ac01 service nova] Releasing lock "refresh_cache-a604ade1-7e60-40f5-a20e-f5047653b103" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:01.114430 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquired lock "refresh_cache-a604ade1-7e60-40f5-a20e-f5047653b103" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:01.114581 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:01.182979 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:01.341041 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Creating config drive at /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.config May 27 21:04:01.344752 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphybewbfi {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:01.397909 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphybewbfi" returned: 0 in 0.053s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:01.535077 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.975s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:01.538546 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 2.204s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:01.617197 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Deleted allocations for instance 9992b23e-7582-49b6-977c-45dfc6f43ea3 May 27 21:04:01.710270 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:04:01.783662 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:01.894294 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:01.933923 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:01.936199 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:02.054058 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:04:02.054302 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Claim successful on node np0000001553 May 27 21:04:02.062124 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:02.284953 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-885cd5a4-9a9c-4f61-9981-6bfe396346d0 req-910b12e2-aeb1-465b-80aa-144e68f1b791 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:02.284953 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-885cd5a4-9a9c-4f61-9981-6bfe396346d0 req-910b12e2-aeb1-465b-80aa-144e68f1b791 service nova] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:02.284953 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-885cd5a4-9a9c-4f61-9981-6bfe396346d0 req-910b12e2-aeb1-465b-80aa-144e68f1b791 service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:02.284953 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-885cd5a4-9a9c-4f61-9981-6bfe396346d0 req-910b12e2-aeb1-465b-80aa-144e68f1b791 service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:02.284953 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-885cd5a4-9a9c-4f61-9981-6bfe396346d0 req-910b12e2-aeb1-465b-80aa-144e68f1b791 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Processing event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:04:02.301065 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Updating instance_info_cache with network_info: [{"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:02.314550 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:02.348138 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:02.375445 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:02.485257 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:02.567532 np0000001553 nova-compute[98213]: INFO nova.compute.resource_tracker [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updating resource usage from migration 126d7534-18ae-47d0-8e5e-05e63db17386 May 27 21:04:02.635010 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-e8d49ced-694e-4246-8f86-a403004f19e8 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "9992b23e-7582-49b6-977c-45dfc6f43ea3" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.863s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:02.821312 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Releasing lock "refresh_cache-a604ade1-7e60-40f5-a20e-f5047653b103" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:02.821660 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Instance network_info: |[{"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:04:02.824154 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Start _get_guest_xml network_info=[{"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:04:02.833634 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:04:02.834860 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2128456159', uuid='a604ade1-7e60-40f5-a20e-f5047653b103'), owner=OwnerMeta(userid='bc3a4342c86f437986a3c05ea178bec8', username='tempest-ServerRescueNegativeTestJSON-1361072921-project-member', projectid='1acfdacf68cd433a94e1b4e91cfc6ffc', projectname='tempest-ServerRescueNegativeTestJSON-1361072921'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915842.8334) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:04:02.836654 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:04:02.837180 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:04:02.838201 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:04:02.838352 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:04:02.839231 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:04:02.839503 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:04:02.839637 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:04:02.839731 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:04:02.839831 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:04:02.841301 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:04:02.841595 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:04:02.841595 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:04:02.841668 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:04:02.841760 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:04:02.841858 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:04:02.841973 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:04:02.853094 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2128456159',display_name='tempest-ServerRescueNegativeTestJSON-server-2128456159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverrescuenegativetestjson-server-2128456159',id=21,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1acfdacf68cd433a94e1b4e91cfc6ffc',ramdisk_id='',reservation_id='r-n95730gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1361072921',owner_user_name='tempest-ServerRescueNegativeTestJSON-1361072921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:59Z,user_data=None,user_id='bc3a4342c86f437986a3c05ea178bec8',uuid=a604ade1-7e60-40f5-a20e-f5047653b103,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:04:02.853254 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converting VIF {"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:02.853723 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:10:ec,bridge_name='br-int',has_traffic_filtering=True,id=186fdbd5-b446-44a8-946a-f7b66d257204,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap186fdbd5-b4') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:02.854285 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'pci_devices' on Instance uuid a604ade1-7e60-40f5-a20e-f5047653b103 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:02.947084 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:02.947246 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] VM Started (Lifecycle Event) May 27 21:04:02.948799 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:04:02.953486 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:04:02.955397 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Instance spawned successfully. May 27 21:04:02.956675 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:04:03.361682 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] End _get_guest_xml xml= May 27 21:04:03.361682 np0000001553 nova-compute[98213]: a604ade1-7e60-40f5-a20e-f5047653b103 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: instance-00000015 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 196608 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 1 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-server-2128456159 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 2026-05-27 21:04:02 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 192 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 1 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 0 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 0 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 1 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: True May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: bare May 27 21:04:03.361682 np0000001553 nova-compute[98213]: qcow2 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 1 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 0 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: virtio May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-1361072921-project-member May 27 21:04:03.361682 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-1361072921 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:04:03.361682 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: a604ade1-7e60-40f5-a20e-f5047653b103 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: a604ade1-7e60-40f5-a20e-f5047653b103 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: hvm May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 128 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: 1 May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: Nehalem May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: May 27 21:04:03.361682 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:04:03.366414 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Preparing to wait for external event network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:04:03.366414 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:03.366414 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:03.366414 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:03.366414 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2128456159',display_name='tempest-ServerRescueNegativeTestJSON-server-2128456159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverrescuenegativetestjson-server-2128456159',id=21,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1acfdacf68cd433a94e1b4e91cfc6ffc',ramdisk_id='',reservation_id='r-n95730gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1361072921',owner_user_name='tempest-ServerRescueNegativeTestJSON-1361072921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:59Z,user_data=None,user_id='bc3a4342c86f437986a3c05ea178bec8',uuid=a604ade1-7e60-40f5-a20e-f5047653b103,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:04:03.367640 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converting VIF {"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:03.367640 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:10:ec,bridge_name='br-int',has_traffic_filtering=True,id=186fdbd5-b446-44a8-946a-f7b66d257204,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap186fdbd5-b4') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:03.367640 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:10:ec,bridge_name='br-int',has_traffic_filtering=True,id=186fdbd5-b446-44a8-946a-f7b66d257204,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap186fdbd5-b4') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:04:03.367640 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:03.367640 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:03.367640 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:04:03.368663 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:03.368925 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eea9c777-af69-5a01-b050-0c8687041a9c', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:03.372668 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:03.379445 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:03.379692 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap186fdbd5-b4, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:03.380618 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap186fdbd5-b4, col_values=(('qos', UUID('a62a8301-570f-4065-ab07-a5273c705a0d')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:03.380886 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap186fdbd5-b4, col_values=(('external_ids', {'iface-id': '186fdbd5-b446-44a8-946a-f7b66d257204', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:10:ec', 'vm-uuid': 'a604ade1-7e60-40f5-a20e-f5047653b103'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:03.382424 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:03.383865 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:03.390951 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:03.394030 np0000001553 nova-compute[98213]: INFO os_vif [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:10:ec,bridge_name='br-int',has_traffic_filtering=True,id=186fdbd5-b446-44a8-946a-f7b66d257204,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap186fdbd5-b4') May 27 21:04:03.401248 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:03.401248 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:03.450854 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:03.454495 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:03.466195 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:03.466195 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:03.466195 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:03.466195 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:03.466195 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:03.466195 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:03.903703 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:03.957761 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:04:03.958054 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:03.958252 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] VM Paused (Lifecycle Event) May 27 21:04:03.974970 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Took 6.72 seconds to spawn the instance on the hypervisor. May 27 21:04:03.975836 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:04.017612 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "d61bda11-c563-480f-9f5f-7d85ef081cae" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:04.017889 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:04.018162 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:04.018348 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:04.018517 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:04.021932 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Terminating instance May 27 21:04:04.364448 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a1763414-969a-4c45-b615-4559cc5b72b0 req-e1e57bc7-ae17-4607-835b-f79227dcc24d service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:04.364661 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a1763414-969a-4c45-b615-4559cc5b72b0 req-e1e57bc7-ae17-4607-835b-f79227dcc24d service nova] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:04.364782 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a1763414-969a-4c45-b615-4559cc5b72b0 req-e1e57bc7-ae17-4607-835b-f79227dcc24d service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:04.364892 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a1763414-969a-4c45-b615-4559cc5b72b0 req-e1e57bc7-ae17-4607-835b-f79227dcc24d service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:04.365004 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a1763414-969a-4c45-b615-4559cc5b72b0 req-e1e57bc7-ae17-4607-835b-f79227dcc24d service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] No waiting events found dispatching network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:04.366127 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-a1763414-969a-4c45-b615-4559cc5b72b0 req-e1e57bc7-ae17-4607-835b-f79227dcc24d service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received unexpected event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 for instance with vm_state active and task_state None. May 27 21:04:04.415151 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.879s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:04.415151 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Migrating May 27 21:04:04.415151 np0000001553 nova-compute[98213]: DEBUG nova.compute.rpcapi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98213) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} May 27 21:04:04.460933 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:04.462414 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:04.462551 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] VM Resumed (Lifecycle Event) May 27 21:04:04.484765 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Took 13.07 seconds to build instance. May 27 21:04:04.528655 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:04:04.559475 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:04.565540 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:04.589543 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:04.741482 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:04.754661 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:04.879895 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Instance destroyed successfully. May 27 21:04:04.880240 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'resources' on Instance uuid d61bda11-c563-480f-9f5f-7d85ef081cae {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:04.929196 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6ee85f94-6a73-40d9-bdca-63faca3a2568 req-f401081b-299c-476b-852b-fafd11716528 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Received event network-vif-unplugged-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:04.930899 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6ee85f94-6a73-40d9-bdca-63faca3a2568 req-f401081b-299c-476b-852b-fafd11716528 service nova] Acquiring lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:04.930899 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6ee85f94-6a73-40d9-bdca-63faca3a2568 req-f401081b-299c-476b-852b-fafd11716528 service nova] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:04.930899 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-6ee85f94-6a73-40d9-bdca-63faca3a2568 req-f401081b-299c-476b-852b-fafd11716528 service nova] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:04.933358 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6ee85f94-6a73-40d9-bdca-63faca3a2568 req-f401081b-299c-476b-852b-fafd11716528 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] No waiting events found dispatching network-vif-unplugged-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:04.933745 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-6ee85f94-6a73-40d9-bdca-63faca3a2568 req-f401081b-299c-476b-852b-fafd11716528 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Received event network-vif-unplugged-9b53f972-5207-4963-8168-a2e2d0871383 for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:04.936034 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:04.936273 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:04.936472 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No VIF found with MAC fa:16:3e:21:10:ec, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:04.937356 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Using config drive May 27 21:04:04.945626 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:04.945834 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquired lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:04.946103 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:04.964907 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:04.968294 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:04.986709 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-b6b4dd36-b1a3-47be-9fa3-4184e090ff77 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.582s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:05.385523 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-613015261',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-613015261',id=14,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:02:45Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-ij4j5vks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:02:54Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=d61bda11-c563-480f-9f5f-7d85ef081cae,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:04:05.385690 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "9b53f972-5207-4963-8168-a2e2d0871383", "address": "fa:16:3e:ad:5c:b7", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b53f972-52", "ovs_interfaceid": "9b53f972-5207-4963-8168-a2e2d0871383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:05.386183 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=9b53f972-5207-4963-8168-a2e2d0871383,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b53f972-52') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:05.386385 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=9b53f972-5207-4963-8168-a2e2d0871383,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b53f972-52') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:04:05.387583 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:05.387896 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b53f972-52, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:05.389324 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:05.390236 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:05.396132 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:05.400385 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:05.400664 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e0392b6-437f-4558-b417-b7c4af8ebf3a) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:05.402383 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:05.403079 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:05.411880 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:05.413864 np0000001553 nova-compute[98213]: INFO os_vif [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=9b53f972-5207-4963-8168-a2e2d0871383,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b53f972-52') May 27 21:04:05.415107 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Deleting instance files /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae_del May 27 21:04:05.415107 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Deletion of /opt/stack/data/nova/instances/d61bda11-c563-480f-9f5f-7d85ef081cae_del complete May 27 21:04:05.443970 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:05.449238 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:05.471506 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999673145000088 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:05.534993 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:05.585241 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Creating config drive at /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.config May 27 21:04:05.590474 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj5ebns7b {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:05.643542 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj5ebns7b" returned: 0 in 0.053s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:05.818436 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:05.925023 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Took 1.40 seconds to destroy the instance on the hypervisor. May 27 21:04:05.926285 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:04:05.927803 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:04:05.927803 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:04:05.928010 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:05.998320 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updating instance_info_cache with network_info: [{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:06.027161 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:06.153853 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:06.192276 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:06.194933 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:06.294441 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:06.377968 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:06.378530 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:06.443882 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9c328fc1-0223-46a7-8a41-739f44e0c12b req-403da8e3-3877-462b-8872-2b89dc973de7 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Received event network-vif-deleted-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:06.445021 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-9c328fc1-0223-46a7-8a41-739f44e0c12b req-403da8e3-3877-462b-8872-2b89dc973de7 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Neutron deleted interface 9b53f972-5207-4963-8168-a2e2d0871383; detaching it from the instance and deleting it from the info cache May 27 21:04:06.447352 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9c328fc1-0223-46a7-8a41-739f44e0c12b req-403da8e3-3877-462b-8872-2b89dc973de7 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Detach interface failed, port_id=9b53f972-5207-4963-8168-a2e2d0871383, reason: Instance d61bda11-c563-480f-9f5f-7d85ef081cae could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:04:06.501637 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Releasing lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:06.784719 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:06.832128 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:07.036526 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Received event network-vif-unplugged-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:07.036526 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] Acquiring lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:07.036526 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:07.036526 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:07.036526 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] No waiting events found dispatching network-vif-unplugged-9b53f972-5207-4963-8168-a2e2d0871383 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:07.036526 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Received event network-vif-unplugged-9b53f972-5207-4963-8168-a2e2d0871383 for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:07.036526 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received event network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:07.036526 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] Acquiring lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:07.036526 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:07.037353 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:07.037353 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Processing event network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:04:07.037353 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received event network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:07.039328 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] Acquiring lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:07.039328 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:07.039328 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:07.039328 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] No waiting events found dispatching network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:07.039550 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-a8e0d5a9-6c77-4806-a562-be62a29d74cd req-864987a1-c1f4-4efa-9a73-7e3d66e53e86 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received unexpected event network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 for instance with vm_state building and task_state spawning. May 27 21:04:07.174800 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:04:07.181208 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:07.181208 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] VM Started (Lifecycle Event) May 27 21:04:07.182442 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:04:07.189704 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Instance spawned successfully. May 27 21:04:07.189704 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:04:07.335280 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Took 1.41 seconds to deallocate network for instance. May 27 21:04:07.691175 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:07.696125 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:07.699184 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:07.699321 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:07.699772 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:07.700403 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:07.700403 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:07.702065 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:07.847278 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:07.847950 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:08.019485 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Starting migrate_disk_and_power_off {{(pid=98213) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}} May 27 21:04:08.046809 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.051821 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.084635 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.198453 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:04:08.198669 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:08.198771 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] VM Paused (Lifecycle Event) May 27 21:04:08.212167 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Took 8.11 seconds to spawn the instance on the hypervisor. May 27 21:04:08.212167 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:08.287003 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.302267 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.314815 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.359249 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4aee3d58-b610-4f8b-ac2e-2bde549d214b req-18a7896c-7212-44ce-afe4-c7b4b4818370 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:08.363635 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4aee3d58-b610-4f8b-ac2e-2bde549d214b req-18a7896c-7212-44ce-afe4-c7b4b4818370 service nova] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:08.363635 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4aee3d58-b610-4f8b-ac2e-2bde549d214b req-18a7896c-7212-44ce-afe4-c7b4b4818370 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:08.363635 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4aee3d58-b610-4f8b-ac2e-2bde549d214b req-18a7896c-7212-44ce-afe4-c7b4b4818370 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:08.363635 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4aee3d58-b610-4f8b-ac2e-2bde549d214b req-18a7896c-7212-44ce-afe4-c7b4b4818370 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] No waiting events found dispatching network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:08.363635 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-4aee3d58-b610-4f8b-ac2e-2bde549d214b req-18a7896c-7212-44ce-afe4-c7b4b4818370 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received unexpected event network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 for instance with vm_state active and task_state resize_migrating. May 27 21:04:08.396197 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.435488 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.447588 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Instance destroyed successfully. May 27 21:04:08.448759 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='multiattach-server-0',id=16,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:13Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-arsqtjru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=59971b35-cbb8-420e-a34e-b614819ad555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "vif_mac": "fa:16:3e:62:2a:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:04:08.450898 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "vif_mac": "fa:16:3e:62:2a:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:08.453240 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:08.453240 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:04:08.454758 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.454758 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbe00ed4-45, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:08.455575 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.457463 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:08.462876 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.465021 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.465316 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bef0937-93b9-4f40-8198-f9d44d731064) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:08.466332 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.467214 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:08.467369 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.472026 np0000001553 nova-compute[98213]: INFO os_vif [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') May 27 21:04:08.639170 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.641240 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.720029 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:08.720029 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:08.720029 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] VM Resumed (Lifecycle Event) May 27 21:04:08.734133 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Took 16.43 seconds to build instance. May 27 21:04:08.824952 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.825845 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:08.920793 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:08.921076 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:09.047849 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Detected multiple connections on this host for volume: be08ca87-a220-43b1-a6c7-12e3d06fb4d3, skipping target disconnect. May 27 21:04:09.053283 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:09.148050 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:09.148714 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:09.231735 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:09.236196 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-333e618f-d9e2-452f-a789-01d816797eee tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "a604ade1-7e60-40f5-a20e-f5047653b103" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.941s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:09.240803 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:09.262550 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:09.263647 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:04:09.265317 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555_resize/disk /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:09.385669 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "cp -r /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555_resize/disk /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk" returned: 0 in 0.121s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:09.385669 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555_resize/disk.config /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.config {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:09.423112 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "cp -r /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555_resize/disk.config /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.config" returned: 0 in 0.037s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:09.423717 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555_resize/disk.info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.info {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:09.437251 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:09.460347 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "cp -r /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555_resize/disk.info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.info" returned: 0 in 0.035s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:09.751389 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] During sync_power_state the instance has a pending task (rescuing). Skip. May 27 21:04:09.752383 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Rescuing May 27 21:04:09.752702 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "refresh_cache-a604ade1-7e60-40f5-a20e-f5047653b103" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:09.752803 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquired lock "refresh_cache-a604ade1-7e60-40f5-a20e-f5047653b103" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:09.753239 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.99909307300004 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:09.753698 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:09.949539 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.099s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:10.010331 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Deleted allocations for instance d61bda11-c563-480f-9f5f-7d85ef081cae May 27 21:04:10.254874 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0007530109999152046 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:10.258161 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:10.258994 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:10.260953 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:10.261200 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=-0.006742153999994116 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:10.262646 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] VM Stopped (Lifecycle Event) May 27 21:04:10.268957 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.014505879999887838 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:10.269951 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:10.270271 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:10.270819 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] VM Stopped (Lifecycle Event) May 27 21:04:10.272270 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=10.198843945999897 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:10.273005 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=10.198087645999976 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:10.446666 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:10.446881 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:10.447020 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:10.447137 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:10.447266 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] No waiting events found dispatching network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:10.447378 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received unexpected event network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 for instance with vm_state active and task_state resize_migrating. May 27 21:04:10.447470 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:10.447617 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:10.447731 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:10.448060 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:10.448060 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] No waiting events found dispatching network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:10.448060 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received unexpected event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 for instance with vm_state active and task_state resize_migrating. May 27 21:04:10.448230 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:10.448456 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:10.448631 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:10.448819 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:10.448925 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] No waiting events found dispatching network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:10.449020 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received unexpected event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 for instance with vm_state active and task_state resize_migrating. May 27 21:04:10.449110 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:10.449819 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:10.449940 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:10.450035 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:10.450942 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] No waiting events found dispatching network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:10.453675 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received unexpected event network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 for instance with vm_state active and task_state resize_migrating. May 27 21:04:10.456165 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:10.456577 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:10.456712 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:10.456846 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:10.456962 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] No waiting events found dispatching network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:10.457525 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-93483500-aa2c-4d26-8283-cbe28ff2ec1b req-076c5192-6192-4d2f-904b-9298a5ff04d2 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received unexpected event network-vif-unplugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 for instance with vm_state active and task_state resize_migrating. May 27 21:04:10.609346 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:10.609461 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:10.669702 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:10.691774 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Port bbe00ed4-45d2-4b31-a1c0-aadcf463da83 binding to destination host np0000001553 is already ACTIVE {{(pid=98213) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} May 27 21:04:10.774887 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: 90152e6a-b6ed-44f4-a430-fed4fa027496] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:10.775335 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-222eda13-c1de-4ae7-b4f3-a1f595887a33 None None] [instance: 9992b23e-7582-49b6-977c-45dfc6f43ea3] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:10.810744 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Updating instance_info_cache with network_info: [{"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:11.019065 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-64bf0077-1d4a-43f7-99a9-276918c2e857 tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "d61bda11-c563-480f-9f5f-7d85ef081cae" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:11.315846 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Releasing lock "refresh_cache-a604ade1-7e60-40f5-a20e-f5047653b103" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:11.512387 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:11.512572 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:11.512718 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:11.512827 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:11.512915 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:11.515231 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Terminating instance May 27 21:04:11.701567 np0000001553 nova-compute[98213]: DEBUG nova.compute.rpcapi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98213) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} May 27 21:04:11.715182 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:11.722772 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.008s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:11.723397 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:11.792833 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.019225 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:04:12.043262 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.058634 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.079046 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.237286 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.245562 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.295199 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9710e875-d0aa-4edc-9627-8ef9d61eadbd req-9bfc959a-9533-4cc7-bde2-d929c66a6cf9 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:12.295377 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9710e875-d0aa-4edc-9627-8ef9d61eadbd req-9bfc959a-9533-4cc7-bde2-d929c66a6cf9 service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:12.296093 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9710e875-d0aa-4edc-9627-8ef9d61eadbd req-9bfc959a-9533-4cc7-bde2-d929c66a6cf9 service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:12.296229 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9710e875-d0aa-4edc-9627-8ef9d61eadbd req-9bfc959a-9533-4cc7-bde2-d929c66a6cf9 service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:12.296436 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9710e875-d0aa-4edc-9627-8ef9d61eadbd req-9bfc959a-9533-4cc7-bde2-d929c66a6cf9 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:12.296531 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9710e875-d0aa-4edc-9627-8ef9d61eadbd req-9bfc959a-9533-4cc7-bde2-d929c66a6cf9 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:12.346906 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999738474999958 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:12.349416 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Instance destroyed successfully. May 27 21:04:12.350015 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'resources' on Instance uuid ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:12.728525 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:12.819268 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:12.819422 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquired lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:12.819568 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:12.857291 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1283714548',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-1283714548',id=10,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:02:23Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-xdon22jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:02:30Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=ee18ee77-6bda-4fb4-ba2b-7a8773411ad4,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:04:12.858646 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "address": "fa:16:3e:de:c7:fc", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf95bc266-b6", "ovs_interfaceid": "f95bc266-b629-40ae-8a9b-8b0df38a03f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:12.859352 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=f95bc266-b629-40ae-8a9b-8b0df38a03f8,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95bc266-b6') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:12.861319 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=f95bc266-b629-40ae-8a9b-8b0df38a03f8,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95bc266-b6') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:04:12.863913 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.864393 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf95bc266-b6, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:12.865577 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.866275 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:12.866880 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.867724 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.867875 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7cecede-322f-4565-867d-ee18af4cd689) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:12.868392 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.868899 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:12.869326 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.871720 np0000001553 nova-compute[98213]: INFO os_vif [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=f95bc266-b629-40ae-8a9b-8b0df38a03f8,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf95bc266-b6') May 27 21:04:12.873942 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:04:12.874305 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:12.874461 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:12.874831 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:12.875126 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e465466e-bf1f-44ad-ba71-972248b28143', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:04:12.875280 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:04:12.907114 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:12.907114 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:12.907114 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:12.907114 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:12.907114 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:12.907114 np0000001553 nova-compute[98213]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d41abcd4-580a-4d2a-9682-a472147135fc (non-flash) May 27 21:04:12.907114 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:12.907114 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:04:12.907114 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:04:12.907114 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:12.907620 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsi session list stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:12.907620 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:12.907620 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:12.907620 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:12.907620 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:12.907620 np0000001553 nova-compute[98213]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d41abcd4-580a-4d2a-9682-a472147135fc (non-flash) May 27 21:04:12.907620 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:12.907620 np0000001553 nova-compute[98213]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:04:12.907620 np0000001553 nova-compute[98213]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143 (non-flash) May 27 21:04:12.907620 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:12.907620 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d41abcd4-580a-4d2a-9682-a472147135fc', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:04:12.907620 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '5')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:04:12.908821 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143', '6')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:04:12.909900 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Resulting device map defaultdict(. at 0x79ced01b1080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'): ({'sde'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:04:12.910125 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Removing multipathed devices sdd, sde {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:04:12.910486 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Flush multipath device 33000000021da23ae {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:04:12.941576 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:04:12.943327 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.948573 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.974924 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:12.989871 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:04:13.039092 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:04:13.039352 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:04:13.041938 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:04:13.058130 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:04:13.061174 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:04:13.077278 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:13.124271 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143, portal: 192.168.40.100,3260] May 27 21:04:13.124271 np0000001553 nova-compute[98213]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143, portal: 192.168.40.100,3260] successful. May 27 21:04:13.124271 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:13.143996 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:13.146693 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:13.150265 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:13.158112 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:13.210358 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143, portal: 192.168.50.100,3260] May 27 21:04:13.210358 np0000001553 nova-compute[98213]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-e465466e-bf1f-44ad-ba71-972248b28143, portal: 192.168.50.100,3260] successful. May 27 21:04:13.210358 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:13.230193 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:13.230436 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:13.230615 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] <== disconnect_volume: return (355ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:13.230729 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:04:13.231028 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Deleting instance files /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4_del May 27 21:04:13.231922 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Deletion of /opt/stack/data/nova/instances/ee18ee77-6bda-4fb4-ba2b-7a8773411ad4_del complete May 27 21:04:13.267538 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999684816999888 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:13.272666 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Instance destroyed successfully. May 27 21:04:13.276004 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'numa_topology' on Instance uuid a604ade1-7e60-40f5-a20e-f5047653b103 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:13.327176 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:13.650557 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:13.746463 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Took 1.73 seconds to destroy the instance on the hypervisor. May 27 21:04:13.747269 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:04:13.747643 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:04:13.747771 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:04:13.747994 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:13.788637 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Attempting rescue May 27 21:04:13.789278 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98213) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} May 27 21:04:13.802290 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Instance directory exists: not creating {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} May 27 21:04:13.802442 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Creating image(s) May 27 21:04:13.803258 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "/opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:13.803462 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "/opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:13.804015 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "/opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:13.804234 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'trusted_certs' on Instance uuid a604ade1-7e60-40f5-a20e-f5047653b103 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:13.817511 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updating instance_info_cache with network_info: [{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:13.937949 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:13.973528 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:14.306361 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:14.307134 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:14.311620 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:14.318167 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:14.318167 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:14.318285 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:14.320640 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Releasing lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:14.325379 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:14.325379 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:14.404162 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:14.404536 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] Acquiring lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:14.404793 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:14.404934 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:14.405055 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] No waiting events found dispatching network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:14.406098 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-unplugged-f95bc266-b629-40ae-8a9b-8b0df38a03f8 for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:14.406098 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received event network-vif-unplugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:14.406098 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] Acquiring lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:14.407111 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:14.407111 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:14.407111 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] No waiting events found dispatching network-vif-unplugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:14.407111 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received unexpected event network-vif-unplugged-186fdbd5-b446-44a8-946a-f7b66d257204 for instance with vm_state active and task_state rescuing. May 27 21:04:14.407337 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received event network-vif-unplugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:14.407337 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] Acquiring lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:14.407487 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:14.407579 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:14.407677 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] No waiting events found dispatching network-vif-unplugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:14.407781 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-4b2bd2f0-e240-4e88-9424-8e2f8586457b req-a3d09245-8949-417e-ac33-511883951848 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received unexpected event network-vif-unplugged-186fdbd5-b446-44a8-946a-f7b66d257204 for instance with vm_state active and task_state rescuing. May 27 21:04:14.416124 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.091s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:14.416481 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.rescue {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:14.478120 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.rescue" returned: 0 in 0.061s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:14.480157 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.161s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:14.485206 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'migration_context' on Instance uuid a604ade1-7e60-40f5-a20e-f5047653b103 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:14.832350 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:14.843427 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:04:14.860945 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:14.898835 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:04:14.903297 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:04:14.911194 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:04:14.913457 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fe04:e8b3', 'fe80::fc16:3eff:fee5:7025', 'fe80::8c51:9fff:febf:6f1f', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fe65:892c', 'fe80::fc16:3eff:fe74:7207', 'fe80::fc16:3eff:fed3:8eb1', 'fe80::8c52:96ff:fe71:ef82', 'fe80::fc16:3eff:febe:44d9', 'fe80::dc70:ecff:feeb:296b'] May 27 21:04:14.913457 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:04:14.913457 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:04:14.915783 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:14.993568 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:14.994241 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:04:14.994866 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Start _get_guest_xml network_info=[{"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "vif_mac": "fa:16:3e:21:10:ec"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue={'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:04:14.995229 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'resources' on Instance uuid a604ade1-7e60-40f5-a20e-f5047653b103 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:15.027927 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:15.497980 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:15.504506 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:04:15.505249 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2128456159', uuid='a604ade1-7e60-40f5-a20e-f5047653b103'), owner=OwnerMeta(userid='bc3a4342c86f437986a3c05ea178bec8', username='tempest-ServerRescueNegativeTestJSON-1361072921-project-member', projectid='1acfdacf68cd433a94e1b4e91cfc6ffc', projectname='tempest-ServerRescueNegativeTestJSON-1361072921'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "vif_mac": "fa:16:3e:21:10:ec"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915855.5042746) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:04:15.510424 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:04:15.511130 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:04:15.513058 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:04:15.513352 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:04:15.516158 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:04:15.516611 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'vcpu_model' on Instance uuid a604ade1-7e60-40f5-a20e-f5047653b103 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:15.530516 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Took 1.78 seconds to deallocate network for instance. May 27 21:04:15.891630 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:16.019113 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:16.035008 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2128456159',display_name='tempest-ServerRescueNegativeTestJSON-server-2128456159',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverrescuenegativetestjson-server-2128456159',id=21,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:04:08Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1acfdacf68cd433a94e1b4e91cfc6ffc',ramdisk_id='',reservation_id='r-n95730gh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1361072921',owner_user_name='tempest-ServerRescueNegativeTestJSON-1361072921-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:08Z,user_data=None,user_id='bc3a4342c86f437986a3c05ea178bec8',uuid=a604ade1-7e60-40f5-a20e-f5047653b103,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "vif_mac": "fa:16:3e:21:10:ec"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:04:16.035224 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converting VIF {"id": "186fdbd5-b446-44a8-946a-f7b66d257204", "address": "fa:16:3e:21:10:ec", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "vif_mac": "fa:16:3e:21:10:ec"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap186fdbd5-b4", "ovs_interfaceid": "186fdbd5-b446-44a8-946a-f7b66d257204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:16.035997 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:10:ec,bridge_name='br-int',has_traffic_filtering=True,id=186fdbd5-b446-44a8-946a-f7b66d257204,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap186fdbd5-b4') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:16.036656 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'pci_devices' on Instance uuid a604ade1-7e60-40f5-a20e-f5047653b103 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:16.053681 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Starting finish_migration {{(pid=98213) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}} May 27 21:04:16.055194 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Instance directory exists: not creating {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} May 27 21:04:16.055307 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Creating image(s) May 27 21:04:16.055909 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:16.098600 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Took 0.57 seconds to detach 1 volumes for instance. May 27 21:04:16.106743 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Deleting volume: e465466e-bf1f-44ad-ba71-972248b28143 {{(pid=98213) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} May 27 21:04:16.142816 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.086s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:16.143047 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:04:16.143521 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:16.244923 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:16.246693 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Cannot resize image /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:04:16.489879 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-70f740c7-d708-4585-a39c-2251fd1c8090 req-ecfa533b-51ef-40fa-9927-2a66d38a71ab service nova] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Received event network-vif-deleted-f95bc266-b629-40ae-8a9b-8b0df38a03f8 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:16.538979 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:16.540979 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] End _get_guest_xml xml= May 27 21:04:16.540979 np0000001553 nova-compute[98213]: a604ade1-7e60-40f5-a20e-f5047653b103 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: instance-00000015 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 196608 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 1 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-server-2128456159 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 2026-05-27 21:04:15 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 192 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 1 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 0 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 0 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 1 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: True May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: bare May 27 21:04:16.540979 np0000001553 nova-compute[98213]: qcow2 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 1 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 0 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: ide May 27 21:04:16.540979 np0000001553 nova-compute[98213]: virtio May 27 21:04:16.540979 np0000001553 nova-compute[98213]: pc May 27 21:04:16.540979 np0000001553 nova-compute[98213]: virtio May 27 21:04:16.540979 np0000001553 nova-compute[98213]: virtio May 27 21:04:16.540979 np0000001553 nova-compute[98213]: virtio May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-1361072921-project-member May 27 21:04:16.540979 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-1361072921 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:04:16.540979 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: a604ade1-7e60-40f5-a20e-f5047653b103 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: a604ade1-7e60-40f5-a20e-f5047653b103 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: hvm May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 128 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: 1 May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: Nehalem May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: May 27 21:04:16.540979 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:04:16.550808 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Instance destroyed successfully. May 27 21:04:16.673882 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:16.674158 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:16.750316 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Did not create local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} May 27 21:04:16.750316 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Ensure instance console log exists: /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:04:16.750316 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:16.750316 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:16.750316 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:16.754029 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Start _get_guest_xml network_info=[{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "vif_mac": "fa:16:3e:62:2a:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '59971b35-cbb8-420e-a34e-b614819ad555', 'attached_at': '2026-05-27T21:04:15.000000', 'detached_at': '', 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'multiattach': True, 'serial': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3'}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '463936e5-4085-4473-bc87-164037ae2262', 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:04:16.757514 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:04:16.760210 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='59971b35-cbb8-420e-a34e-b614819ad555'), owner=OwnerMeta(userid='ac9557e825354813ac31afa70f07ffc7', username='tempest-AttachVolumeMultiAttachTest-1088868426-project-member', projectid='251237411f6e4bb49303c88852d6e9a1', projectname='tempest-AttachVolumeMultiAttachTest-1088868426'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "vif_mac": "fa:16:3e:62:2a:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915856.7597318) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:04:16.761560 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:04:16.762110 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:04:16.763989 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:04:16.764351 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:04:16.765763 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:04:16.766605 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:04:16.766605 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:04:16.766765 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:04:16.767205 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:04:16.767205 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:04:16.767315 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:04:16.767612 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:04:16.767809 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:04:16.768043 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:04:16.768256 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:04:16.768470 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:04:16.788514 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.config --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:16.804452 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:16.927255 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.config --force-share --output=json" returned: 0 in 0.139s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:16.929488 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "/opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:16.929790 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "/opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:16.930399 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "/opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:16.932042 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:04:16.932042 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:16.932042 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:16.932042 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:16.932042 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:04:16.949051 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:16.949696 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:16.950947 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:16.951248 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:04:16.952428 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:16.952686 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.state = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:04:16.970850 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:04:16.970850 np0000001553 nova-compute[98213]: # END RECORD May 27 21:04:16.970850 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:16.978089 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.startup = automatic May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.state = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.scan = manual May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:04:16.978089 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:04:16.978089 np0000001553 nova-compute[98213]: # END RECORD May 27 21:04:16.978089 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:16.986591 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:16.996166 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:17.016367 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:17.016367 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:17.016367 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:17.016367 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:17.016367 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:17.016367 np0000001553 nova-compute[98213]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d41abcd4-580a-4d2a-9682-a472147135fc (non-flash) May 27 21:04:17.016367 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:17.016367 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:17.016684 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:17.016684 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:17.016684 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:17.016684 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:17.016684 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:17.016684 np0000001553 nova-compute[98213]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d41abcd4-580a-4d2a-9682-a472147135fc (non-flash) May 27 21:04:17.016684 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:17.016684 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:17.017130 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:17.017130 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:04:17.018301 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:17.018301 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:17.018301 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:17.018301 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:17.018301 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:17.018301 np0000001553 nova-compute[98213]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d41abcd4-580a-4d2a-9682-a472147135fc (non-flash) May 27 21:04:17.018301 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:17.018301 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:17.020828 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] iscsi session list stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:17.020828 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:17.020828 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:17.020828 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:17.020828 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:17.020828 np0000001553 nova-compute[98213]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d41abcd4-580a-4d2a-9682-a472147135fc (non-flash) May 27 21:04:17.020828 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:17.020828 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:17.021559 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.071s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:17.022790 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('16', '0', '0', 0) found on session 31 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:04:17.023074 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:04:17.023330 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:04:17.024148 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] HCTL ('15', '0', '0', 0) found on session 30 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:04:17.024334 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:04:17.033802 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 31 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:04:17.033961 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:04:17.037537 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Searching for a device in session 30 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:04:17.037537 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'be08ca87-a220-43b1-a6c7-12e3d06fb4d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:04:17.487767 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:17.488015 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:17.868682 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:17.901699 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:17.901807 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:17.951769 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:04:17.994122 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:18.079261 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:18.079508 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:18.079595 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:18.079673 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No VIF found with MAC fa:16:3e:21:10:ec, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:18.080126 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Using config drive May 27 21:04:18.406575 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:04:18.502798 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.829s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:18.549588 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Deleted allocations for instance ee18ee77-6bda-4fb4-ba2b-7a8773411ad4 May 27 21:04:18.582511 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'ec2_ids' on Instance uuid a604ade1-7e60-40f5-a20e-f5047653b103 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:18.956957 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:18.957302 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:18.960209 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:04:18.960398 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Claim successful on node np0000001553 May 27 21:04:18.969602 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Found WWN 33000000069317437 for multipath device dm-6 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:04:18.969905 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.038s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:18.970162 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] <== connect_volume: return (2038ms) {'type': 'block', 'scsi_wwn': '33000000069317437', 'path': '/dev/dm-6', 'multipath_id': '33000000069317437'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:18.970351 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000069317437', 'path': '/dev/dm-6', 'multipath_id': '33000000069317437'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:04:19.085985 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:19.086094 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'keypairs' on Instance uuid a604ade1-7e60-40f5-a20e-f5047653b103 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:19.477582 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000001553',hostname='multiattach-server-0',id=16,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:13Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001553',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-arsqtjru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=59971b35-cbb8-420e-a34e-b614819ad555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "vif_mac": "fa:16:3e:62:2a:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:04:19.477853 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "vif_mac": "fa:16:3e:62:2a:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:19.478753 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:19.486567 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] End _get_guest_xml xml= May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 59971b35-cbb8-420e-a34e-b614819ad555 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: instance-00000010 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 262144 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 1 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: multiattach-server-0 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 2026-05-27 21:04:16 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 256 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 1 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 0 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 0 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 1 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: True May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: bare May 27 21:04:19.486567 np0000001553 nova-compute[98213]: qcow2 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 1 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 0 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: ide May 27 21:04:19.486567 np0000001553 nova-compute[98213]: virtio May 27 21:04:19.486567 np0000001553 nova-compute[98213]: pc May 27 21:04:19.486567 np0000001553 nova-compute[98213]: virtio May 27 21:04:19.486567 np0000001553 nova-compute[98213]: virtio May 27 21:04:19.486567 np0000001553 nova-compute[98213]: virtio May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426-project-member May 27 21:04:19.486567 np0000001553 nova-compute[98213]: tempest-AttachVolumeMultiAttachTest-1088868426 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:04:19.486567 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 59971b35-cbb8-420e-a34e-b614819ad555 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 59971b35-cbb8-420e-a34e-b614819ad555 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: hvm May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 128 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: 1 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: Nehalem May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: be08ca87-a220-43b1-a6c7-12e3d06fb4d3 May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: May 27 21:04:19.486567 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:04:19.490102 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000001553',hostname='multiattach-server-0',id=16,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI57gWF7hu48KhEzZTzezbyQiT2Efxo/1h0VcdrykT8ZkSJbaMn6HfSVeL8VyS7e3CmIXpfD8oJYL4DrxeJVMQmmhzbo5amNbtLJWgKCma3ou0uE6wFcfU7hIzuHv4Yj6g==',key_name='tempest-keypair-1863052478',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:13Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001553',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='251237411f6e4bb49303c88852d6e9a1',ramdisk_id='',reservation_id='r-arsqtjru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1088868426',owner_user_name='tempest-AttachVolumeMultiAttachTest-1088868426-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac9557e825354813ac31afa70f07ffc7',uuid=59971b35-cbb8-420e-a34e-b614819ad555,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "vif_mac": "fa:16:3e:62:2a:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:04:19.490370 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converting VIF {"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "vif_mac": "fa:16:3e:62:2a:d4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:19.490926 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:19.491340 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:04:19.492983 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:19.493294 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:19.493606 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:04:19.495995 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:19.496200 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b7cb160-7cef-5b31-8896-17c1c40d343e', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:19.497821 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:19.499774 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:19.505796 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:19.508246 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:19.508705 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbe00ed4-45, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:19.509033 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbe00ed4-45, col_values=(('qos', UUID('8afbc633-c0d9-464c-a6c5-20d6fdb2aa8c')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:19.509290 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbe00ed4-45, col_values=(('external_ids', {'iface-id': 'bbe00ed4-45d2-4b31-a1c0-aadcf463da83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:2a:d4', 'vm-uuid': '59971b35-cbb8-420e-a34e-b614819ad555'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:19.510468 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:19.511968 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:19.521271 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:19.522583 np0000001553 nova-compute[98213]: INFO os_vif [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:2a:d4,bridge_name='br-int',has_traffic_filtering=True,id=bbe00ed4-45d2-4b31-a1c0-aadcf463da83,network=Network(2efc5470-da6b-4b9b-8cbc-f8cfb462ec95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbe00ed4-45') May 27 21:04:19.566745 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f2fc1649-39cb-4122-a421-73d1676f370a tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "ee18ee77-6bda-4fb4-ba2b-7a8773411ad4" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.054s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:19.590094 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:19.600015 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:19.781105 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Creating config drive at /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.config.rescue May 27 21:04:19.784773 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8k3bwi80 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:19.846443 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8k3bwi80" returned: 0 in 0.060s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:20.347118 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:20.348013 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "f4397c41-4087-4367-b1ac-46e8cc475772" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:20.348013 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "f4397c41-4087-4367-b1ac-46e8cc475772" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:20.348255 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:20.348255 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:20.348471 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:20.355564 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Terminating instance May 27 21:04:20.384641 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:20.452024 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:20.472121 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.001006790000019464 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:20.472260 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:20.473704 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.2799244979999 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:20.473849 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.2784798949999185 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:20.476162 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-4b0e633d-8eb3-421a-9b22-15d2598c84b8 None None] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:20.476392 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-4b0e633d-8eb3-421a-9b22-15d2598c84b8 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] VM Stopped (Lifecycle Event) May 27 21:04:20.534645 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:20.551592 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:20.574290 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c0083062-a61e-4699-bde2-93a346a36c65 req-73aaa0d6-d7d7-45c6-b16a-ed57bab1adf6 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received event network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:20.574751 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c0083062-a61e-4699-bde2-93a346a36c65 req-73aaa0d6-d7d7-45c6-b16a-ed57bab1adf6 service nova] Acquiring lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:20.574934 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c0083062-a61e-4699-bde2-93a346a36c65 req-73aaa0d6-d7d7-45c6-b16a-ed57bab1adf6 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:20.575073 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-c0083062-a61e-4699-bde2-93a346a36c65 req-73aaa0d6-d7d7-45c6-b16a-ed57bab1adf6 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:20.575260 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-c0083062-a61e-4699-bde2-93a346a36c65 req-73aaa0d6-d7d7-45c6-b16a-ed57bab1adf6 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] No waiting events found dispatching network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:20.575419 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-c0083062-a61e-4699-bde2-93a346a36c65 req-73aaa0d6-d7d7-45c6-b16a-ed57bab1adf6 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received unexpected event network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 for instance with vm_state active and task_state rescuing. May 27 21:04:20.747580 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:20.747882 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:20.800706 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:20.803303 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:20.860321 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:04:20.887274 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:20.893794 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:20.919244 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:20.922218 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:20.953999 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:20.981224 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-4b0e633d-8eb3-421a-9b22-15d2598c84b8 None None] [instance: d61bda11-c563-480f-9f5f-7d85ef081cae] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:21.054404 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:21.055443 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:21.055678 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:21.055833 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] No VIF found with MAC fa:16:3e:62:2a:d4, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:21.057310 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Using config drive May 27 21:04:21.251844 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:21.264165 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for a604ade1-7e60-40f5-a20e-f5047653b103 due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:04:21.264411 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:21.264630 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] VM Resumed (Lifecycle Event) May 27 21:04:21.267271 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-c836404f-c30e-4e3a-bb81-1c96909d3113 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:21.307846 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Detaching volume 495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:04:21.362998 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Attempting to driver detach volume 495837fb-9572-47a8-82af-4a6a5707f496 from mountpoint /dev/vdb May 27 21:04:21.373950 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Found disk vdb by alias ua-495837fb-9572-47a8-82af-4a6a5707f496 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:04:21.378455 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Found disk vdb by alias ua-495837fb-9572-47a8-82af-4a6a5707f496 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:04:21.378794 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Attempting to detach device vdb from instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:04:21.379047 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] detach device xml: May 27 21:04:21.379047 np0000001553 nova-compute[98213]: May 27 21:04:21.379047 np0000001553 nova-compute[98213]: May 27 21:04:21.379047 np0000001553 nova-compute[98213]: May 27 21:04:21.379047 np0000001553 nova-compute[98213]: May 27 21:04:21.379047 np0000001553 nova-compute[98213]: 495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:04:21.379047 np0000001553 nova-compute[98213]:
May 27 21:04:21.379047 np0000001553 nova-compute[98213]: May 27 21:04:21.379047 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:04:21.381350 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Instance destroyed successfully. May 27 21:04:21.382000 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lazy-loading 'resources' on Instance uuid f4397c41-4087-4367-b1ac-46e8cc475772 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:21.387794 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Successfully detached device vdb from instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f from the persistent domain config. May 27 21:04:21.387961 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] (1/8): Attempting to detach device vdb with device alias ua-495837fb-9572-47a8-82af-4a6a5707f496 from instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f from the live domain config. {{(pid=98213) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} May 27 21:04:21.388203 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] detach device xml: May 27 21:04:21.388203 np0000001553 nova-compute[98213]: May 27 21:04:21.388203 np0000001553 nova-compute[98213]: May 27 21:04:21.388203 np0000001553 nova-compute[98213]: May 27 21:04:21.388203 np0000001553 nova-compute[98213]: May 27 21:04:21.388203 np0000001553 nova-compute[98213]: 495837fb-9572-47a8-82af-4a6a5707f496 May 27 21:04:21.388203 np0000001553 nova-compute[98213]:
May 27 21:04:21.388203 np0000001553 nova-compute[98213]: May 27 21:04:21.388203 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:04:21.647479 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.681927 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.757928 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.801s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:21.758705 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:04:21.761166 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.773165 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:21.784214 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:21.797425 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.838830 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.847001 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.884288 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-157525005',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverbootfromvolumestablerescuetest-server-157525005',id=1,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:01:29Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='79fe4bede0c741bfb93a23985eeef42e',ramdisk_id='',reservation_id='r-s3ah9e66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:01:39Z,user_data=None,user_id='18e30c231082464ab556592986d8b793',uuid=f4397c41-4087-4367-b1ac-46e8cc475772,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:04:21.884534 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converting VIF {"id": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "address": "fa:16:3e:04:e8:b3", "network": {"id": "430f4b10-057c-437f-b529-a3eea6daef0e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2000910892-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "79fe4bede0c741bfb93a23985eeef42e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe1aa92c-fc", "ovs_interfaceid": "be1aa92c-fc86-4acd-8cae-2a0feb29f6df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:21.885309 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:b3,bridge_name='br-int',has_traffic_filtering=True,id=be1aa92c-fc86-4acd-8cae-2a0feb29f6df,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe1aa92c-fc') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:21.885404 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:b3,bridge_name='br-int',has_traffic_filtering=True,id=be1aa92c-fc86-4acd-8cae-2a0feb29f6df,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe1aa92c-fc') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:04:21.886573 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.886757 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe1aa92c-fc, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:21.887988 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.889019 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:21.895170 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.896804 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.897047 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=046b781a-c787-49b6-8027-bd3f5158f1f7) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:21.897679 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:21.899490 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:21.901688 np0000001553 nova-compute[98213]: INFO os_vif [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:e8:b3,bridge_name='br-int',has_traffic_filtering=True,id=be1aa92c-fc86-4acd-8cae-2a0feb29f6df,network=Network(430f4b10-057c-437f-b529-a3eea6daef0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe1aa92c-fc') May 27 21:04:21.901975 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Deleting instance files /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772_del May 27 21:04:21.902750 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Deletion of /opt/stack/data/nova/instances/f4397c41-4087-4367-b1ac-46e8cc475772_del complete May 27 21:04:21.971832 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9553ebbd-ffc2-4411-8e26-f6d3ce13776e req-3c6a7d14-26c3-4c67-bcd5-3360e4df3523 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:21.972040 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9553ebbd-ffc2-4411-8e26-f6d3ce13776e req-3c6a7d14-26c3-4c67-bcd5-3360e4df3523 service nova] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:21.972253 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9553ebbd-ffc2-4411-8e26-f6d3ce13776e req-3c6a7d14-26c3-4c67-bcd5-3360e4df3523 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:21.972419 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9553ebbd-ffc2-4411-8e26-f6d3ce13776e req-3c6a7d14-26c3-4c67-bcd5-3360e4df3523 service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:21.972550 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9553ebbd-ffc2-4411-8e26-f6d3ce13776e req-3c6a7d14-26c3-4c67-bcd5-3360e4df3523 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] No waiting events found dispatching network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:21.972697 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-9553ebbd-ffc2-4411-8e26-f6d3ce13776e req-3c6a7d14-26c3-4c67-bcd5-3360e4df3523 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received unexpected event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 for instance with vm_state active and task_state resize_finish. May 27 21:04:22.008860 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-495837fb-9572-47a8-82af-4a6a5707f496 for instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f {{(pid=98213) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} May 27 21:04:22.265452 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:04:22.265642 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:04:22.265973 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:22.266239 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:22.290163 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:22.290163 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] VM Started (Lifecycle Event) May 27 21:04:22.359442 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be4a7a374626443b92bdba82619f4fd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8120e91cccf1439b93cc5a173791dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:04:22.412429 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Took 1.55 seconds to destroy the instance on the hypervisor. May 27 21:04:22.413011 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:04:22.413085 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:04:22.415167 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:04:22.415167 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:22.502745 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Instance event wait completed in 0 seconds for {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:04:22.507589 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Instance running successfully. May 27 21:04:22.507759 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Failed to set time: agent not configured {{(pid=98213) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} May 27 21:04:22.507936 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-012ea0dd-a13b-4048-a864-bdbeb1e59982 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] finish_migration finished successfully. {{(pid=98213) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}} May 27 21:04:22.560644 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:22.639093 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received event network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:22.640166 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] Acquiring lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:22.640166 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:22.640166 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] Lock "a604ade1-7e60-40f5-a20e-f5047653b103-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:22.640166 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] No waiting events found dispatching network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:22.640315 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Received unexpected event network-vif-plugged-186fdbd5-b446-44a8-946a-f7b66d257204 for instance with vm_state rescued and task_state None. May 27 21:04:22.640515 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received event network-vif-unplugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:22.642435 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] Acquiring lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:22.642917 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:22.643076 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:22.643258 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] No waiting events found dispatching network-vif-unplugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:22.643258 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received event network-vif-unplugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:22.643357 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received event network-vif-unplugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:22.643483 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] Acquiring lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:22.643595 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:22.644159 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] Lock "f4397c41-4087-4367-b1ac-46e8cc475772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:22.644159 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] No waiting events found dispatching network-vif-unplugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:22.644159 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d061b5cd-44bd-41c7-a197-0cd84d46e39d req-5f876726-70a8-4898-82f5-8e628840ee26 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received event network-vif-unplugged-be1aa92c-fc86-4acd-8cae-2a0feb29f6df for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:22.761891 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Successfully created port: b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:04:22.768701 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:04:22.790891 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:22.792668 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a604ade1-7e60-40f5-a20e-f5047653b103] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:23.263480 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Successfully updated port: b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:04:23.280103 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:04:23.456482 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:23.476408 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999712487999886 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:23.477565 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Received event ua-495837fb-9572-47a8-82af-4a6a5707f496> from libvirt while the driver is waiting for it; dispatched. {{(pid=98213) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} May 27 21:04:23.479099 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for 59971b35-cbb8-420e-a34e-b614819ad555 due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:04:23.480131 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:23.480255 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] VM Resumed (Lifecycle Event) May 27 21:04:23.482923 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Successfully detached device vdb from instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f from the live domain config. May 27 21:04:23.483930 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:04:23.484212 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:23.484360 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:23.484690 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:23.484944 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '495837fb-9572-47a8-82af-4a6a5707f496', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:04:23.486813 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:04:23.510986 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:23.510986 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:23.510986 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:23.510986 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:23.510986 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:23.510986 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:23.510986 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:23.511178 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [28] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:23.511178 np0000001553 nova-compute[98213]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496 (non-flash) May 27 21:04:23.511178 np0000001553 nova-compute[98213]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:23.511178 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:23.511178 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:23.511178 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:23.511178 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:23.511319 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:04:23.511319 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '28')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:04:23.512231 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496', '29')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:04:23.513335 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Resulting device map defaultdict(. at 0x79ceb0202de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'): ({'sdg'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:04:23.513694 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Removing multipathed devices sdf, sdg {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:04:23.513926 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Flush multipath device 3300000009a7456fc {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:04:23.546046 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:04:23.581687 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:04:23.624887 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:04:23.625042 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:04:23.625939 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:04:23.641824 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:04:23.641824 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:04:23.652217 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:23.685492 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.40.100,3260] May 27 21:04:23.685492 np0000001553 nova-compute[98213]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.40.100,3260] successful. May 27 21:04:23.685492 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:23.702706 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:23.719085 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:23.759882 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.50.100,3260] May 27 21:04:23.759882 np0000001553 nova-compute[98213]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-495837fb-9572-47a8-82af-4a6a5707f496, portal: 192.168.50.100,3260] successful. May 27 21:04:23.759882 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:23.766283 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "refresh_cache-a9faa280-cc00-4b18-8ef8-a5eb7408d655" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:23.766283 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquired lock "refresh_cache-a9faa280-cc00-4b18-8ef8-a5eb7408d655" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:23.766283 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:23.775986 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:23.776261 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:23.776425 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] <== disconnect_volume: return (291ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:23.776617 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:04:23.978527 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Took 1.57 seconds to deallocate network for instance. May 27 21:04:23.986969 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:23.993308 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:24.038867 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:24.039391 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:24.039560 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:24.039711 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] Lock "59971b35-cbb8-420e-a34e-b614819ad555-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:24.039867 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] No waiting events found dispatching network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:24.040014 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received unexpected event network-vif-plugged-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 for instance with vm_state resized and task_state None. May 27 21:04:24.040169 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Received event network-changed-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:24.040311 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Refreshing instance network info cache due to event network-changed-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:04:24.040452 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] Acquiring lock "refresh_cache-a9faa280-cc00-4b18-8ef8-a5eb7408d655" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:24.054436 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Rescuing May 27 21:04:24.054585 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:24.054673 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquired lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:24.054783 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:24.190908 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "59971b35-cbb8-420e-a34e-b614819ad555" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:24.191098 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:24.191202 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Going to confirm migration 2 {{(pid=98213) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}} May 27 21:04:24.327797 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lazy-loading 'flavor' on Instance uuid a8b6e8af-99d6-4ab7-82c7-68af9f22c24f {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:24.340798 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:04:24.483916 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:04:24.484856 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:04:24.485066 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Creating image(s) May 27 21:04:24.485509 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:24.485651 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "/opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:24.486038 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "/opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:24.487150 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:24.489762 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:24.491934 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:24.492543 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:24.492543 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:24.519193 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:24.519466 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] VM Started (Lifecycle Event) May 27 21:04:24.529600 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:24.557040 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:24.573177 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.081s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:24.573689 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:24.574228 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:24.574723 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:24.578347 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:24.578843 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:24.663234 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.084s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:24.663729 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:24.724031 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:24.729727 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk 1073741824" returned: 0 in 0.066s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:24.735629 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.160s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:24.735629 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-2966a027-3d33-43f8-8b34-66c6e99632a4 req-3c5a18b5-e3ed-4589-83af-4b1e396686b2 service nova] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Received event network-vif-deleted-be1aa92c-fc86-4acd-8cae-2a0feb29f6df {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:24.736045 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:24.763651 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.011133724000046641 future=) was cancelled during its delay period, skipping {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:24.763842 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:24.764230 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.582508835999988 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:24.767391 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.5823341020000043 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:24.807924 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Updating instance_info_cache with network_info: [{"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:24.823416 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.086s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:24.823416 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:04:24.823416 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:24.884468 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:24.884833 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:24.884951 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquired lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:24.888162 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:24.888162 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'info_cache' on Instance uuid 59971b35-cbb8-420e-a34e-b614819ad555 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:24.925469 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:24.925981 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Cannot resize image /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:04:24.926660 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:04:24.926988 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Ensure instance console log exists: /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:04:24.927404 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:24.927644 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:24.928096 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:25.037085 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:25.039128 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:25.109695 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:25.290067 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Updating instance_info_cache with network_info: [{"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:25.311383 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Releasing lock "refresh_cache-a9faa280-cc00-4b18-8ef8-a5eb7408d655" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:25.312235 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Instance network_info: |[{"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:04:25.312426 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] Acquired lock "refresh_cache-a9faa280-cc00-4b18-8ef8-a5eb7408d655" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:25.317855 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Start _get_guest_xml network_info=[{"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:04:25.318392 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Refreshing network info cache for port b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:04:25.321650 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:04:25.323680 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-315885919', uuid='a9faa280-cc00-4b18-8ef8-a5eb7408d655'), owner=OwnerMeta(userid='be4a7a374626443b92bdba82619f4fd5', username='tempest-DeleteServersTestJSON-1578533523-project-member', projectid='8120e91cccf1439b93cc5a173791dbe2', projectname='tempest-DeleteServersTestJSON-1578533523'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915865.3231575) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:04:25.325441 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:04:25.326024 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:04:25.327415 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:04:25.328496 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:04:25.330025 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:04:25.330497 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:04:25.330694 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:04:25.330833 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:04:25.331042 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:04:25.332241 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:04:25.332802 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:04:25.333063 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:04:25.333280 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:04:25.333618 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:04:25.334060 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:04:25.334531 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:04:25.355945 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-315885919',display_name='tempest-DeleteServersTestJSON-server-315885919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-deleteserverstestjson-server-315885919',id=22,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8120e91cccf1439b93cc5a173791dbe2',ramdisk_id='',reservation_id='r-qmw9t7ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1578533523',owner_user_name='tempest-DeleteServersTestJSON-1578533523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:24Z,user_data=None,user_id='be4a7a374626443b92bdba82619f4fd5',uuid=a9faa280-cc00-4b18-8ef8-a5eb7408d655,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:04:25.356370 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Converting VIF {"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:25.359733 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50,network=Network(64b7d080-db83-426e-8593-230a09e4926b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bb40c3-2e') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:25.361484 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lazy-loading 'pci_devices' on Instance uuid a9faa280-cc00-4b18-8ef8-a5eb7408d655 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:25.369787 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-8e2f04eb-1330-411d-8ad0-1d4d09193b51 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.566s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:25.424468 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:25.424682 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:25.792907 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Releasing lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:25.825023 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:25.867638 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] End _get_guest_xml xml= May 27 21:04:25.867638 np0000001553 nova-compute[98213]: a9faa280-cc00-4b18-8ef8-a5eb7408d655 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: instance-00000016 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 196608 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 1 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: tempest-DeleteServersTestJSON-server-315885919 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 2026-05-27 21:04:25 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 192 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 1 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 0 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 0 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 1 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: True May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: bare May 27 21:04:25.867638 np0000001553 nova-compute[98213]: qcow2 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 1 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 0 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: virtio May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: tempest-DeleteServersTestJSON-1578533523-project-member May 27 21:04:25.867638 np0000001553 nova-compute[98213]: tempest-DeleteServersTestJSON-1578533523 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:04:25.867638 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: a9faa280-cc00-4b18-8ef8-a5eb7408d655 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: a9faa280-cc00-4b18-8ef8-a5eb7408d655 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: hvm May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 128 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: 1 May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: Nehalem May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: May 27 21:04:25.867638 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:04:25.871639 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Preparing to wait for external event network-vif-plugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:04:25.871639 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:25.871639 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:25.871639 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:25.871639 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-315885919',display_name='tempest-DeleteServersTestJSON-server-315885919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-deleteserverstestjson-server-315885919',id=22,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8120e91cccf1439b93cc5a173791dbe2',ramdisk_id='',reservation_id='r-qmw9t7ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1578533523',owner_user_name='tempest-DeleteServersTestJSON-1578533523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:24Z,user_data=None,user_id='be4a7a374626443b92bdba82619f4fd5',uuid=a9faa280-cc00-4b18-8ef8-a5eb7408d655,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:04:25.871872 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Converting VIF {"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:25.871872 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50,network=Network(64b7d080-db83-426e-8593-230a09e4926b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bb40c3-2e') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:25.872156 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50,network=Network(64b7d080-db83-426e-8593-230a09e4926b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bb40c3-2e') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:04:25.872967 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:25.879268 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:25.879650 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:04:25.881074 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:25.881311 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b1d21c5-abce-598d-aa5e-d640c82be56b', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:25.882326 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:25.882782 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:25.886778 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:25.889826 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:25.893602 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:25.893602 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9bb40c3-2e, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:25.893602 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9bb40c3-2e, col_values=(('qos', UUID('baa8578e-7cf5-4825-a5aa-9a66e6b4f0b7')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:25.893602 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9bb40c3-2e, col_values=(('external_ids', {'iface-id': 'b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:99:7d', 'vm-uuid': 'a9faa280-cc00-4b18-8ef8-a5eb7408d655'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:25.895653 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:25.899647 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:25.900262 np0000001553 nova-compute[98213]: INFO os_vif [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50,network=Network(64b7d080-db83-426e-8593-230a09e4926b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bb40c3-2e') May 27 21:04:25.929552 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:26.227612 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:26.227612 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:26.227612 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:26.227847 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:26.227847 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:26.230013 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Terminating instance May 27 21:04:26.246002 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:26.377229 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:26.431787 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Updated VIF entry in instance network info cache for port b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:04:26.432606 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Updating instance_info_cache with network_info: [{"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:26.442735 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.950s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:26.503586 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Deleted allocations for instance f4397c41-4087-4367-b1ac-46e8cc475772 May 27 21:04:26.541952 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updating instance_info_cache with network_info: [{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:26.660156 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:04:26.660734 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:04:26.734744 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:04:26.769757 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:26.778826 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:26.809061 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:26.934406 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-d76ee9c5-d005-4141-a197-7bcd5aeef225 req-93e054eb-78db-4f73-bb5e-ff5296ec1a1d service nova] Releasing lock "refresh_cache-a9faa280-cc00-4b18-8ef8-a5eb7408d655" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:26.950626 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-91421758-f3c2-45d0-a6cb-01b5be2828c9 req-9a477476-53f9-4d59-871f-398611e12ca9 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:26.950626 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-91421758-f3c2-45d0-a6cb-01b5be2828c9 req-9a477476-53f9-4d59-871f-398611e12ca9 service nova] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:26.950746 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-91421758-f3c2-45d0-a6cb-01b5be2828c9 req-9a477476-53f9-4d59-871f-398611e12ca9 service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:26.950867 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-91421758-f3c2-45d0-a6cb-01b5be2828c9 req-9a477476-53f9-4d59-871f-398611e12ca9 service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:26.952423 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-91421758-f3c2-45d0-a6cb-01b5be2828c9 req-9a477476-53f9-4d59-871f-398611e12ca9 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] No waiting events found dispatching network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:26.954451 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-91421758-f3c2-45d0-a6cb-01b5be2828c9 req-9a477476-53f9-4d59-871f-398611e12ca9 service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:26.964170 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:26.971075 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.045303 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Releasing lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:27.045303 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lazy-loading 'migration_context' on Instance uuid 59971b35-cbb8-420e-a34e-b614819ad555 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:27.073229 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999750118000065 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:27.075413 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Instance destroyed successfully. May 27 21:04:27.075865 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lazy-loading 'resources' on Instance uuid a8b6e8af-99d6-4ab7-82c7-68af9f22c24f {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:27.347414 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004392680000364635 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:27.347414 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:27.347414 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.9196637349998582 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:27.347636 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=0.9195469989999765 future=) was cancelled while queued, skipping {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:27.347636 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:27.347727 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=11.128369475 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:27.349875 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=11.128264540999908 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:27.349875 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:27.349875 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] VM Stopped (Lifecycle Event) May 27 21:04:27.419133 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:27.419313 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:27.419428 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] No VIF found with MAC fa:16:3e:e5:99:7d, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:27.419892 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Using config drive May 27 21:04:27.510199 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.514114 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.522597 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-c4cf20c6-ae54-4e58-9ec6-0eb5494bcf2d tempest-ServerBootFromVolumeStableRescueTest-1106755838 tempest-ServerBootFromVolumeStableRescueTest-1106755838-project-member] Lock "f4397c41-4087-4367-b1ac-46e8cc475772" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.174s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:27.536184 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.550805 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Object Instance<59971b35-cbb8-420e-a34e-b614819ad555> lazy-loaded attributes: info_cache,migration_context {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:27.563633 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:27.564438 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:27.578418 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-27T21:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1815635338',display_name='tempest-ServerActionsTestOtherA-server-1150672827',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-tempest-common-compute-instance-1815635338',id=13,image_ref='e25494d4-a649-4a75-ab22-12240ef97c22',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhRyl/gHlTk3NR31kz1TMU4ugUtNRNhvt3/is5Ou9Gh8FfxeQaQSkn9eAA9+1tgiBOuvzlKK/vItMkljBAUDewfhHBGnxPq32YISNTcCVOesxqFgmJRR6kSx4SB246g4g==',key_name='tempest-keypair-1121332834',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:42Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='b562b6a1ba2b4c3ab101af22f9d04713',ramdisk_id='',reservation_id='r-mometahb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e25494d4-a649-4a75-ab22-12240ef97c22',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-113699651',owner_user_name='tempest-ServerActionsTestOtherA-113699651-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99659c2947e743c899512883f5a85b0e',uuid=a8b6e8af-99d6-4ab7-82c7-68af9f22c24f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:04:27.578819 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converting VIF {"id": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "address": "fa:16:3e:74:72:07", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2dc1bc4-0c", "ovs_interfaceid": "a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:27.579090 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:27.579356 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:04:27.580737 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.580954 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2dc1bc4-0c, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:27.583846 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:27.596070 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.599856 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.599856 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b09144c-2631-45d7-a4f3-cab4872ba3f7) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:27.600405 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.601043 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:27.609777 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.613300 np0000001553 nova-compute[98213]: INFO os_vif [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:72:07,bridge_name='br-int',has_traffic_filtering=True,id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2dc1bc4-0c') May 27 21:04:27.613650 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Deleting instance files /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f_del May 27 21:04:27.614568 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Deletion of /opt/stack/data/nova/instances/a8b6e8af-99d6-4ab7-82c7-68af9f22c24f_del complete May 27 21:04:27.661348 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:04:27.661348 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:04:27.712552 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.726793 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:27.737534 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-dea5867e-90c9-4ea0-84d8-37c1482a0ae9 req-fe252cc0-65da-456d-92cc-805b29bfa0c3 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:27.739460 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-dea5867e-90c9-4ea0-84d8-37c1482a0ae9 req-fe252cc0-65da-456d-92cc-805b29bfa0c3 service nova] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:27.739668 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-dea5867e-90c9-4ea0-84d8-37c1482a0ae9 req-fe252cc0-65da-456d-92cc-805b29bfa0c3 service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:27.739716 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-dea5867e-90c9-4ea0-84d8-37c1482a0ae9 req-fe252cc0-65da-456d-92cc-805b29bfa0c3 service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:27.739985 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-dea5867e-90c9-4ea0-84d8-37c1482a0ae9 req-fe252cc0-65da-456d-92cc-805b29bfa0c3 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] No waiting events found dispatching network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:27.740197 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-dea5867e-90c9-4ea0-84d8-37c1482a0ae9 req-fe252cc0-65da-456d-92cc-805b29bfa0c3 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received unexpected event network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 for instance with vm_state active and task_state rescuing. May 27 21:04:27.823016 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999724230999846 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:27.824579 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Instance destroyed successfully. May 27 21:04:27.824990 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'numa_topology' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:27.854062 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-61a281de-edc4-455a-8128-1d50d5b85a6e tempest-VolumesAdminNegativeTest-1133816629 tempest-VolumesAdminNegativeTest-1133816629-project-member] [instance: ee18ee77-6bda-4fb4-ba2b-7a8773411ad4] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:27.927021 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:28.084881 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Creating config drive at /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk.config May 27 21:04:28.092268 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjlyy75qa {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:28.131699 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Took 1.40 seconds to destroy the instance on the hypervisor. May 27 21:04:28.133135 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:04:28.133452 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:04:28.133676 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:04:28.134824 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:28.159165 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjlyy75qa" returned: 0 in 0.067s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:28.229587 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:28.330158 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Attempting rescue May 27 21:04:28.330830 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98213) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} May 27 21:04:28.335224 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Instance directory exists: not creating {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} May 27 21:04:28.335224 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Creating image(s) May 27 21:04:28.341406 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "/opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:28.341406 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "/opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:28.341406 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "/opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:28.341406 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'trusted_certs' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:28.656600 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:04:28.658132 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:04:28.659437 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:04:28.659638 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:04:28.659817 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:04:28.659942 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98213) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} May 27 21:04:28.660188 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:04:28.710069 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:28.748615 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:28.754782 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:28.846737 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance<28fe4f34-f07e-4eef-bc7e-59ad5d8adfef> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:28.846737 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:28.855206 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:28.863326 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:28.863326 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:28.863326 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:28.879869 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:28.887654 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:28.889162 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:28.927932 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:28.927932 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:28.993261 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.105s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:28.994446 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.rescue {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:29.009891 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:29.040184 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-596343f9-ae4f-4f3d-a729-16274e4211ef req-59c0afd8-0ecb-4542-aeea-2ba008e0544c service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:29.040642 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-596343f9-ae4f-4f3d-a729-16274e4211ef req-59c0afd8-0ecb-4542-aeea-2ba008e0544c service nova] Acquiring lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:29.040757 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-596343f9-ae4f-4f3d-a729-16274e4211ef req-59c0afd8-0ecb-4542-aeea-2ba008e0544c service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:29.040900 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-596343f9-ae4f-4f3d-a729-16274e4211ef req-59c0afd8-0ecb-4542-aeea-2ba008e0544c service nova] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:29.041018 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-596343f9-ae4f-4f3d-a729-16274e4211ef req-59c0afd8-0ecb-4542-aeea-2ba008e0544c service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] No waiting events found dispatching network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:29.041177 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-596343f9-ae4f-4f3d-a729-16274e4211ef req-59c0afd8-0ecb-4542-aeea-2ba008e0544c service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-unplugged-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:29.043069 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-596343f9-ae4f-4f3d-a729-16274e4211ef req-59c0afd8-0ecb-4542-aeea-2ba008e0544c service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Received event network-vif-deleted-a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:29.043339 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-596343f9-ae4f-4f3d-a729-16274e4211ef req-59c0afd8-0ecb-4542-aeea-2ba008e0544c service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Neutron deleted interface a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb; detaching it from the instance and deleting it from the info cache May 27 21:04:29.047295 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-596343f9-ae4f-4f3d-a729-16274e4211ef req-59c0afd8-0ecb-4542-aeea-2ba008e0544c service nova] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Detach interface failed, port_id=a2dc1bc4-0c2a-474f-a46c-f8f8b87b96fb, reason: Instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:04:29.058376 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.rescue" returned: 0 in 0.064s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:29.058771 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.198s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:29.058985 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'migration_context' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:29.082631 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-db726f51-f865-4f6a-8856-c0599a91cc66 req-2cdb6e57-35bc-40ad-8960-8bae1d946676 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Received event network-vif-plugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:29.083819 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-db726f51-f865-4f6a-8856-c0599a91cc66 req-2cdb6e57-35bc-40ad-8960-8bae1d946676 service nova] Acquiring lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:29.083819 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-db726f51-f865-4f6a-8856-c0599a91cc66 req-2cdb6e57-35bc-40ad-8960-8bae1d946676 service nova] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:29.083980 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-db726f51-f865-4f6a-8856-c0599a91cc66 req-2cdb6e57-35bc-40ad-8960-8bae1d946676 service nova] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:29.084042 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-db726f51-f865-4f6a-8856-c0599a91cc66 req-2cdb6e57-35bc-40ad-8960-8bae1d946676 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Processing event network-vif-plugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:04:29.146014 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:29.153405 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:29.155128 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:29.183041 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:29.183041 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:29.434059 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:29.441761 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:29.563837 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance<28fe4f34-f07e-4eef-bc7e-59ad5d8adfef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:29.564105 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:04:29.564615 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Start _get_guest_xml network_info=[{"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "vif_mac": "fa:16:3e:be:44:d9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue={'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:04:29.564796 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'resources' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:29.579201 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:29.579602 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:04:29.579721 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] VM Started (Lifecycle Event) May 27 21:04:29.584646 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:04:29.584646 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Instance spawned successfully. May 27 21:04:29.584646 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:04:29.660085 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager.update_available_resource {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:04:29.834222 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-21af36f0-6857-4bfc-a177-8f55706260ee req-544e0030-dbbc-4181-a0bd-292270eae3a7 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:29.834427 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-21af36f0-6857-4bfc-a177-8f55706260ee req-544e0030-dbbc-4181-a0bd-292270eae3a7 service nova] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:29.834585 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-21af36f0-6857-4bfc-a177-8f55706260ee req-544e0030-dbbc-4181-a0bd-292270eae3a7 service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:29.834722 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-21af36f0-6857-4bfc-a177-8f55706260ee req-544e0030-dbbc-4181-a0bd-292270eae3a7 service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:29.834861 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-21af36f0-6857-4bfc-a177-8f55706260ee req-544e0030-dbbc-4181-a0bd-292270eae3a7 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] No waiting events found dispatching network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:29.834995 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-21af36f0-6857-4bfc-a177-8f55706260ee req-544e0030-dbbc-4181-a0bd-292270eae3a7 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received unexpected event network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 for instance with vm_state active and task_state rescuing. May 27 21:04:29.952869 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Took 1.82 seconds to deallocate network for instance. May 27 21:04:30.067264 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance<28fe4f34-f07e-4eef-bc7e-59ad5d8adfef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:30.071067 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:04:30.072750 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-470319356', uuid='28fe4f34-f07e-4eef-bc7e-59ad5d8adfef'), owner=OwnerMeta(userid='bc3a4342c86f437986a3c05ea178bec8', username='tempest-ServerRescueNegativeTestJSON-1361072921-project-member', projectid='1acfdacf68cd433a94e1b4e91cfc6ffc', projectname='tempest-ServerRescueNegativeTestJSON-1361072921'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "vif_mac": "fa:16:3e:be:44:d9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915870.0723014) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:04:30.074313 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:04:30.074746 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:04:30.075942 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:04:30.076153 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:04:30.077275 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:04:30.077713 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:04:30.077881 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:04:30.081575 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:04:30.082103 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:04:30.082226 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:04:30.082336 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:04:30.082537 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:04:30.082632 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:04:30.082839 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:04:30.083808 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:30.083973 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:04:30.084122 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:04:30.084278 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:30.090917 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:30.094857 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:30.095033 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:30.095504 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:30.096082 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:30.096545 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:30.096935 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:30.172524 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:30.469346 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.905s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:30.474125 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.297s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:30.474125 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.004s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:30.474125 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Auditing locally available compute resources for np0000001553 (node: np0000001553) {{(pid=98213) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} May 27 21:04:30.476361 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:30.480217 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:30.530246 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "interface-c14c8d62-737e-4297-88bf-f9ee3cc16dfa-None" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:30.530494 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "interface-c14c8d62-737e-4297-88bf-f9ee3cc16dfa-None" acquired by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:30.531102 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lazy-loading 'flavor' on Instance uuid c14c8d62-737e-4297-88bf-f9ee3cc16dfa {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:30.595160 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:04:30.595546 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:30.595740 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] VM Paused (Lifecycle Event) May 27 21:04:30.597257 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance<28fe4f34-f07e-4eef-bc7e-59ad5d8adfef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:30.605327 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Took 6.12 seconds to spawn the instance on the hypervisor. May 27 21:04:30.605572 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:30.628041 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-470319356',display_name='tempest-ServerRescueNegativeTestJSON-server-470319356',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverrescuenegativetestjson-server-470319356',id=20,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:04:03Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='1acfdacf68cd433a94e1b4e91cfc6ffc',ramdisk_id='',reservation_id='r-6h61m9yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1361072921',owner_user_name='tempest-ServerRescueNegativeTestJSON-1361072921-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:04Z,user_data=None,user_id='bc3a4342c86f437986a3c05ea178bec8',uuid=28fe4f34-f07e-4eef-bc7e-59ad5d8adfef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "vif_mac": "fa:16:3e:be:44:d9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:04:30.628041 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converting VIF {"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "vif_mac": "fa:16:3e:be:44:d9"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:30.628041 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:44:d9,bridge_name='br-int',has_traffic_filtering=True,id=c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2fb2ba7-dd') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:30.628401 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'pci_devices' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:31.035289 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:31.053367 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquiring lock "47a99920-efad-44f2-b7f4-55a90d97f110" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:31.053632 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "47a99920-efad-44f2-b7f4-55a90d97f110" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:31.113211 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:31.120829 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:31.120961 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] VM Resumed (Lifecycle Event) May 27 21:04:31.136939 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance<28fe4f34-f07e-4eef-bc7e-59ad5d8adfef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:31.143051 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Took 12.23 seconds to build instance. May 27 21:04:31.145624 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] End _get_guest_xml xml= May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef May 27 21:04:31.145624 np0000001553 nova-compute[98213]: instance-00000014 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 196608 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 1 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-server-470319356 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 2026-05-27 21:04:30 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 192 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 1 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 0 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 0 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 1 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: True May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: bare May 27 21:04:31.145624 np0000001553 nova-compute[98213]: qcow2 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 1 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 0 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: ide May 27 21:04:31.145624 np0000001553 nova-compute[98213]: virtio May 27 21:04:31.145624 np0000001553 nova-compute[98213]: pc May 27 21:04:31.145624 np0000001553 nova-compute[98213]: virtio May 27 21:04:31.145624 np0000001553 nova-compute[98213]: virtio May 27 21:04:31.145624 np0000001553 nova-compute[98213]: virtio May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-1361072921-project-member May 27 21:04:31.145624 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-1361072921 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:04:31.145624 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef May 27 21:04:31.145624 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: hvm May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 128 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: 1 May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: Nehalem May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: May 27 21:04:31.145624 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:04:31.150022 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Instance destroyed successfully. May 27 21:04:31.173604 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-30e0f276-ded9-4f14-9ca1-e1185dd71fac req-4d87cdf5-6cf7-4e0b-94ba-fe54d8dfed30 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Received event network-vif-plugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:31.183308 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Deleted allocation for migration 126d7534-18ae-47d0-8e5e-05e63db17386 May 27 21:04:31.188079 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-30e0f276-ded9-4f14-9ca1-e1185dd71fac req-4d87cdf5-6cf7-4e0b-94ba-fe54d8dfed30 service nova] Acquiring lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:31.188319 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-30e0f276-ded9-4f14-9ca1-e1185dd71fac req-4d87cdf5-6cf7-4e0b-94ba-fe54d8dfed30 service nova] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.006s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:31.188460 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-30e0f276-ded9-4f14-9ca1-e1185dd71fac req-4d87cdf5-6cf7-4e0b-94ba-fe54d8dfed30 service nova] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:31.188590 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-30e0f276-ded9-4f14-9ca1-e1185dd71fac req-4d87cdf5-6cf7-4e0b-94ba-fe54d8dfed30 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] No waiting events found dispatching network-vif-plugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:31.188708 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-30e0f276-ded9-4f14-9ca1-e1185dd71fac req-4d87cdf5-6cf7-4e0b-94ba-fe54d8dfed30 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Received unexpected event network-vif-plugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 for instance with vm_state active and task_state None. May 27 21:04:31.245790 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lazy-loading 'pci_requests' on Instance uuid c14c8d62-737e-4297-88bf-f9ee3cc16dfa {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:31.248308 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:31.248486 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:31.533167 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:31.561255 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:04:31.626859 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:31.635600 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:31.646214 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:31.649488 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:31.670528 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-699e83cd-f740-4f09-b875-7214084d077a tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.768s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:31.691617 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9dbe20b4-4cca-47ed-8931-89081ebf99ca tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] Lock "59971b35-cbb8-420e-a34e-b614819ad555" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 7.500s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:31.742551 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c8d62-737e-4297-88bf-f9ee3cc16dfa/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:31.747819 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:31.750773 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Object Instance lazy-loaded attributes: flavor,pci_requests {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:31.750971 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:04:31.751420 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:31.751680 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:31.773169 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:31.811549 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:31.867021 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f824052f16e642148868fa2d1df1f3db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d3d950b316142468c97cb18a90f7492', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:04:31.871622 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:31.872093 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:31.970425 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:31.974295 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:32.066573 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:32.071540 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:32.176504 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:32.181349 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c8ea02-9725-47ed-b34b-13ea3552d09b/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:32.186865 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:04:32.188235 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:32.303010 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.822s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:32.305923 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.127s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:32.311505 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:04:32.311769 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Claim successful on node np0000001553 May 27 21:04:32.315887 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:32.321575 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:32.412233 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Deleted allocations for instance a8b6e8af-99d6-4ab7-82c7-68af9f22c24f May 27 21:04:32.422085 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Successfully created port: 4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:04:32.438498 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6108bdf-d518-447f-927d-43d7fa6456e2/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:32.443513 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:32.576222 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:32.576222 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:32.601945 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:32.662580 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59971b35-cbb8-420e-a34e-b614819ad555/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:32.663973 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:04:32.669176 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:32.689456 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:32.689708 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:32.689908 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:32.690104 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] No VIF found with MAC fa:16:3e:be:44:d9, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:32.691540 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Using config drive May 27 21:04:32.756441 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:32.757027 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:32.859433 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d92e4c8c-8850-42c6-b960-09e248044889/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:32.860055 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98213) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} May 27 21:04:32.864033 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.rescue --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:32.963977 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.rescue --force-share --output=json" returned: 0 in 0.100s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:32.964575 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.rescue --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:33.058079 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk.rescue --force-share --output=json" returned: 0 in 0.093s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:33.058935 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:33.083011 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Successfully updated port: 4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:04:33.157131 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:33.158822 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:33.174533 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-67fb8927-6d29-4258-ae37-8fe08935f3ab req-8f942f7f-6e02-4b57-93e1-fde017b013ea service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Received event network-changed-4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:33.175452 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-67fb8927-6d29-4258-ae37-8fe08935f3ab req-8f942f7f-6e02-4b57-93e1-fde017b013ea service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Refreshing instance network info cache due to event network-changed-4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:04:33.175807 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-67fb8927-6d29-4258-ae37-8fe08935f3ab req-8f942f7f-6e02-4b57-93e1-fde017b013ea service nova] Acquiring lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:33.175973 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-67fb8927-6d29-4258-ae37-8fe08935f3ab req-8f942f7f-6e02-4b57-93e1-fde017b013ea service nova] Acquired lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:33.176571 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-67fb8927-6d29-4258-ae37-8fe08935f3ab req-8f942f7f-6e02-4b57-93e1-fde017b013ea service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Refreshing network info cache for port 4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:04:33.199200 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'ec2_ids' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:33.284972 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a604ade1-7e60-40f5-a20e-f5047653b103/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:33.288867 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.rescue --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:33.345396 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:33.345679 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.004s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:33.377016 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.rescue --force-share --output=json" returned: 0 in 0.089s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:33.377685 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.rescue --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:33.429323 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-5a8df6dc-ec7a-4ef8-8762-08e80257c642 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a8b6e8af-99d6-4ab7-82c7-68af9f22c24f" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.201s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:33.471993 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.rescue --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:33.471993 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:33.579260 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:33.580026 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:33.595892 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:33.673604 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:33.674051 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Periodic task is updating the host stat, it is trying to get disk instance-00000014, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.config.rescue' May 27 21:04:33.677440 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:33.695589 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-67fb8927-6d29-4258-ae37-8fe08935f3ab req-8f942f7f-6e02-4b57-93e1-fde017b013ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:33.708734 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance<28fe4f34-f07e-4eef-bc7e-59ad5d8adfef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:33.709075 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'keypairs' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:33.761517 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:33.762861 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:33.854345 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lazy-loading 'flavor' on Instance uuid a9faa280-cc00-4b18-8ef8-a5eb7408d655 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:33.857338 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698b750b-959f-4358-b7a0-5f68e76f5a4a/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:33.861716 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:04:33.862995 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:33.924179 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] CMD "env LANG=C uptime" returned: 0 in 0.060s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:33.924869 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Hypervisor/Node resource view: name=np0000001553 free_ram=11499MB free_disk=74.19527435302734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98213) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} May 27 21:04:33.928199 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:33.934937 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-60d66206-63e3-449b-8a30-c3c239b40c40 req-c7f3b35c-f898-4e1b-9851-956d7101a1c8 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Received event network-changed-e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:33.934937 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-60d66206-63e3-449b-8a30-c3c239b40c40 req-c7f3b35c-f898-4e1b-9851-956d7101a1c8 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Refreshing instance network info cache due to event network-changed-e2c88b36-e738-45b0-8280-cb54bfc3a4ea. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:04:33.934937 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-60d66206-63e3-449b-8a30-c3c239b40c40 req-c7f3b35c-f898-4e1b-9851-956d7101a1c8 service nova] Acquiring lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:33.934937 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-60d66206-63e3-449b-8a30-c3c239b40c40 req-c7f3b35c-f898-4e1b-9851-956d7101a1c8 service nova] Acquired lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:33.935063 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-60d66206-63e3-449b-8a30-c3c239b40c40 req-c7f3b35c-f898-4e1b-9851-956d7101a1c8 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Refreshing network info cache for port e2c88b36-e738-45b0-8280-cb54bfc3a4ea {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:04:34.127777 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-67fb8927-6d29-4258-ae37-8fe08935f3ab req-8f942f7f-6e02-4b57-93e1-fde017b013ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:34.136206 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:34.136414 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:34.215024 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance<28fe4f34-f07e-4eef-bc7e-59ad5d8adfef> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:34.219733 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:34.318166 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-67fb8927-6d29-4258-ae37-8fe08935f3ab req-8f942f7f-6e02-4b57-93e1-fde017b013ea service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Added VIF to instance network info cache for port 4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3530}} May 27 21:04:34.318166 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-67fb8927-6d29-4258-ae37-8fe08935f3ab req-8f942f7f-6e02-4b57-93e1-fde017b013ea service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Updating instance_info_cache with network_info: [{"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "address": "fa:16:3e:a8:47:0b", "network": {"id": "955decd4-cb14-477b-915e-e299dd140660", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-601472937", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b216ef0-5d", "ovs_interfaceid": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:34.387155 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Creating config drive at /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.config.rescue May 27 21:04:34.391641 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnwiwizxe {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:34.441303 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-60d66206-63e3-449b-8a30-c3c239b40c40 req-c7f3b35c-f898-4e1b-9851-956d7101a1c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:34.444403 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/28fe4f34-f07e-4eef-bc7e-59ad5d8adfef/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnwiwizxe" returned: 0 in 0.053s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:34.641296 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:34.797953 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-60d66206-63e3-449b-8a30-c3c239b40c40 req-c7f3b35c-f898-4e1b-9851-956d7101a1c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:34.819357 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-67fb8927-6d29-4258-ae37-8fe08935f3ab req-8f942f7f-6e02-4b57-93e1-fde017b013ea service nova] Releasing lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:34.819766 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquired lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:34.820657 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:34.868099 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.522s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:34.953898 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:34.989380 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-60d66206-63e3-449b-8a30-c3c239b40c40 req-c7f3b35c-f898-4e1b-9851-956d7101a1c8 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Updated VIF entry in instance network info cache for port e2c88b36-e738-45b0-8280-cb54bfc3a4ea. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:04:34.989380 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-60d66206-63e3-449b-8a30-c3c239b40c40 req-c7f3b35c-f898-4e1b-9851-956d7101a1c8 service nova] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Updating instance_info_cache with network_info: [{"id": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "address": "fa:16:3e:65:89:2c", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape2c88b36-e7", "ovs_interfaceid": "e2c88b36-e738-45b0-8280-cb54bfc3a4ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:34.989882 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:35.065679 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:35.133476 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:35.134354 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:35.153663 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.850s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:35.154699 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.228s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:35.155867 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:04:35.229037 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a838b22b-ddb6-45fe-9a4e-18512b3feeba req-96a36463-32f8-4837-b85d-1a611c972c42 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:35.229408 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a838b22b-ddb6-45fe-9a4e-18512b3feeba req-96a36463-32f8-4837-b85d-1a611c972c42 service nova] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:35.229654 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a838b22b-ddb6-45fe-9a4e-18512b3feeba req-96a36463-32f8-4837-b85d-1a611c972c42 service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:35.229783 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-a838b22b-ddb6-45fe-9a4e-18512b3feeba req-96a36463-32f8-4837-b85d-1a611c972c42 service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:35.229938 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-a838b22b-ddb6-45fe-9a4e-18512b3feeba req-96a36463-32f8-4837-b85d-1a611c972c42 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] No waiting events found dispatching network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:35.232652 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-a838b22b-ddb6-45fe-9a4e-18512b3feeba req-96a36463-32f8-4837-b85d-1a611c972c42 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received unexpected event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 for instance with vm_state active and task_state rescuing. May 27 21:04:35.429298 np0000001553 nova-compute[98213]: WARNING nova.network.neutron [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] 955decd4-cb14-477b-915e-e299dd140660 already exists in list: networks containing: ['955decd4-cb14-477b-915e-e299dd140660']. ignoring it May 27 21:04:35.429475 np0000001553 nova-compute[98213]: WARNING nova.network.neutron [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] 4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 already exists in list: port_ids containing: ['4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4']. ignoring it May 27 21:04:35.492994 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-60d66206-63e3-449b-8a30-c3c239b40c40 req-c7f3b35c-f898-4e1b-9851-956d7101a1c8 service nova] Releasing lock "refresh_cache-d92e4c8c-8850-42c6-b960-09e248044889" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:35.661626 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:35.673165 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:04:35.673165 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:04:35.674871 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:35.674871 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:35.846161 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-94d64498-11cc-4407-af7d-6db45174acc7 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:35.846517 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:04:35.846675 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:35.847041 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] VM Resumed (Lifecycle Event) May 27 21:04:35.862310 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14e43424fca24d5d962d1165ffa09c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416095e9da0e422fa4a807ed7ad79d66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:04:35.952312 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:35.953424 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:35.953424 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Attaching volume 04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 to /dev/vdb May 27 21:04:36.000231 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:36.013798 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:36.025442 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-1491ed4a-ae5f-4809-8e4f-91f590a64aaa req-32260595-86e9-4357-96b3-afcdbc6124a1 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Received event network-changed-bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:36.026187 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-1491ed4a-ae5f-4809-8e4f-91f590a64aaa req-32260595-86e9-4357-96b3-afcdbc6124a1 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Refreshing instance network info cache due to event network-changed-bbe00ed4-45d2-4b31-a1c0-aadcf463da83. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:04:36.026795 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-1491ed4a-ae5f-4809-8e4f-91f590a64aaa req-32260595-86e9-4357-96b3-afcdbc6124a1 service nova] Acquiring lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:36.026920 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-1491ed4a-ae5f-4809-8e4f-91f590a64aaa req-32260595-86e9-4357-96b3-afcdbc6124a1 service nova] Acquired lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:36.027288 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-1491ed4a-ae5f-4809-8e4f-91f590a64aaa req-32260595-86e9-4357-96b3-afcdbc6124a1 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Refreshing network info cache for port bbe00ed4-45d2-4b31-a1c0-aadcf463da83 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:04:36.028471 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:04:36.060947 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:36.107779 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:04:36.108070 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:04:36.118692 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:04:36.119926 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fee5:7025', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fe65:892c', 'fe80::fc16:3eff:fed3:8eb1', 'fe80::8c52:96ff:fe71:ef82', 'fe80::dc70:ecff:feeb:296b', 'fe80::fc16:3eff:fe21:10ec', 'fe80::fc16:3eff:fe62:2ad4', 'fe80::fc16:3eff:fee5:997d', 'fe80::147a:faff:fe2e:4fb2', 'fe80::fc16:3eff:febe:44d9'] May 27 21:04:36.120082 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:04:36.120234 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:04:36.120472 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:36.120804 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Updating existing volume attachment record: 6ad94f0c-e7e4-4488-bf53-eabcc6385e1d {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:04:36.175942 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Updating instance_info_cache with network_info: [{"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "address": "fa:16:3e:a8:47:0b", "network": {"id": "955decd4-cb14-477b-915e-e299dd140660", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-601472937", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b216ef0-5d", "ovs_interfaceid": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:36.182658 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:04:36.258795 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance f0c8ea02-9725-47ed-b34b-13ea3552d09b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.258895 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 1597a38f-a6a7-45bd-86ec-3938926c5cc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.258975 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance a6108bdf-d518-447f-927d-43d7fa6456e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.259054 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 698b750b-959f-4358-b7a0-5f68e76f5a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.259178 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance d92e4c8c-8850-42c6-b960-09e248044889 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.259907 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance c14c8d62-737e-4297-88bf-f9ee3cc16dfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.259968 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.260131 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance a604ade1-7e60-40f5-a20e-f5047653b103 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.260268 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 59971b35-cbb8-420e-a34e-b614819ad555 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.260568 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance a9faa280-cc00-4b18-8ef8-a5eb7408d655 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.260634 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Instance 47a99920-efad-44f2-b7f4-55a90d97f110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98213) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} May 27 21:04:36.260867 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} May 27 21:04:36.261674 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Final resource view: name=np0000001553 phys_ram=24030MB used_ram=2688MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 21:04:33 up 30 min, 2 users, load average: 9.72, 5.97, 2.79\n', 'num_instances': '11', 'num_vm_active': '9', 'num_task_None': '10', 'num_os_type_None': '11', 'num_proj_b562b6a1ba2b4c3ab101af22f9d04713': '1', 'io_workload': '2', 'num_proj_251237411f6e4bb49303c88852d6e9a1': '5', 'num_proj_5d3d950b316142468c97cb18a90f7492': '1', 'num_task_rescuing': '1', 'num_proj_1acfdacf68cd433a94e1b4e91cfc6ffc': '2', 'num_vm_rescued': '1', 'num_proj_8120e91cccf1439b93cc5a173791dbe2': '1', 'num_vm_building': '1', 'num_proj_416095e9da0e422fa4a807ed7ad79d66': '1'} {{(pid=98213) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} May 27 21:04:36.355194 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:36.365299 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:36.531250 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-1491ed4a-ae5f-4809-8e4f-91f590a64aaa req-32260595-86e9-4357-96b3-afcdbc6124a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:36.678645 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Releasing lock "refresh_cache-c14c8d62-737e-4297-88bf-f9ee3cc16dfa" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:36.685173 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1684979265',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-device-tagging-server-1684979265',id=19,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABNarNLahDnng7/wSw1U6VJLJIZ1Fxfgc8+XlIMoOiZvjeGdsfxl/D5ByDbf+lIN+rOYuVHGWI9P2IXAYVEu/i/jFpvvcmq0kuMQuuhLXndBD8rPL3i0TKKC7m9cQx9hQ==',key_name='tempest-keypair-799556134',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:51Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5d3d950b316142468c97cb18a90f7492',ramdisk_id='',reservation_id='r-jflni0f0',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-125489879',owner_user_name='tempest-TaggedAttachmentsTest-125489879-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:03:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f824052f16e642148868fa2d1df1f3db',uuid=c14c8d62-737e-4297-88bf-f9ee3cc16dfa,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "address": "fa:16:3e:a8:47:0b", "network": {"id": "955decd4-cb14-477b-915e-e299dd140660", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-601472937", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b216ef0-5d", "ovs_interfaceid": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:04:36.685173 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Converting VIF {"id": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "address": "fa:16:3e:a8:47:0b", "network": {"id": "955decd4-cb14-477b-915e-e299dd140660", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-601472937", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b216ef0-5d", "ovs_interfaceid": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:36.685173 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:47:0b,bridge_name='br-int',has_traffic_filtering=True,id=4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4,network=Network(955decd4-cb14-477b-915e-e299dd140660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b216ef0-5d') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:36.686975 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:47:0b,bridge_name='br-int',has_traffic_filtering=True,id=4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4,network=Network(955decd4-cb14-477b-915e-e299dd140660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b216ef0-5d') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:04:36.686975 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:36.686975 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:36.686975 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:04:36.690598 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Successfully created port: be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:04:36.693227 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:36.693227 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7796acfa-6844-5905-8141-c5009a2fd48d', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:36.695682 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:36.697762 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:04:36.708395 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:36.715221 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:04:36.715221 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:36.715221 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:36.715953 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:36.716128 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:04:36.716714 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:36.717025 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b216ef0-5d, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:36.717665 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b216ef0-5d, col_values=(('qos', UUID('64706b6c-24d7-418b-8f98-3e54e1b4fe37')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:36.717788 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b216ef0-5d, col_values=(('external_ids', {'iface-id': '4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:47:0b', 'vm-uuid': 'c14c8d62-737e-4297-88bf-f9ee3cc16dfa'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:36.721953 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:36.724029 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:36.725298 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:36.729858 np0000001553 nova-compute[98213]: INFO os_vif [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:47:0b,bridge_name='br-int',has_traffic_filtering=True,id=4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4,network=Network(955decd4-cb14-477b-915e-e299dd140660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b216ef0-5d') May 27 21:04:36.729858 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1684979265',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-device-tagging-server-1684979265',id=19,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABNarNLahDnng7/wSw1U6VJLJIZ1Fxfgc8+XlIMoOiZvjeGdsfxl/D5ByDbf+lIN+rOYuVHGWI9P2IXAYVEu/i/jFpvvcmq0kuMQuuhLXndBD8rPL3i0TKKC7m9cQx9hQ==',key_name='tempest-keypair-799556134',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:51Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5d3d950b316142468c97cb18a90f7492',ramdisk_id='',reservation_id='r-jflni0f0',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-125489879',owner_user_name='tempest-TaggedAttachmentsTest-125489879-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:03:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f824052f16e642148868fa2d1df1f3db',uuid=c14c8d62-737e-4297-88bf-f9ee3cc16dfa,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "address": "fa:16:3e:a8:47:0b", "network": {"id": "955decd4-cb14-477b-915e-e299dd140660", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-601472937", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b216ef0-5d", "ovs_interfaceid": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:04:36.729858 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Converting VIF {"id": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "address": "fa:16:3e:a8:47:0b", "network": {"id": "955decd4-cb14-477b-915e-e299dd140660", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-601472937", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b216ef0-5d", "ovs_interfaceid": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:36.730534 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:47:0b,bridge_name='br-int',has_traffic_filtering=True,id=4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4,network=Network(955decd4-cb14-477b-915e-e299dd140660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b216ef0-5d') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:36.731251 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] attach device xml: May 27 21:04:36.731251 np0000001553 nova-compute[98213]: May 27 21:04:36.731251 np0000001553 nova-compute[98213]: May 27 21:04:36.731251 np0000001553 nova-compute[98213]: May 27 21:04:36.731251 np0000001553 nova-compute[98213]: May 27 21:04:36.731251 np0000001553 nova-compute[98213]: May 27 21:04:36.731251 np0000001553 nova-compute[98213]: May 27 21:04:36.731251 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:04:36.736935 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:36.736935 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:36.736935 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:04:36.736935 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:36.737425 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:36.737577 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:04:36.747472 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:36.786621 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:04:36.786621 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:36.789342 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:04:36.789342 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:36.812631 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5] added May 27 21:04:36.812631 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:04:36.812631 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:36.812631 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:36.812631 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:36.812631 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:36.812631 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:36.813092 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:04:36.813092 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0767(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:04:36.813205 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:04:36.820344 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5] added May 27 21:04:36.820344 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:04:36.820344 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:36.820344 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:36.820344 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:36.820344 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:36.820344 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:36.820344 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:04:36.820344 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0814(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:04:36.820344 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:04:36.827259 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:36.828273 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:36.839583 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:36.868917 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:36.868917 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] VM Started (Lifecycle Event) May 27 21:04:36.914746 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:37.171547 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:37.172031 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:37.323190 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:37.329016 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:37.356084 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:37.357444 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:37.377221 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:37.386624 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:37.394636 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-1491ed4a-ae5f-4809-8e4f-91f590a64aaa req-32260595-86e9-4357-96b3-afcdbc6124a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:37.584450 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-aceda586-9e73-41fa-ab40-2bd1908dd02a req-4aef55c4-c17a-4fb8-9238-6f0163c5c865 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:37.584684 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aceda586-9e73-41fa-ab40-2bd1908dd02a req-4aef55c4-c17a-4fb8-9238-6f0163c5c865 service nova] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:37.585043 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aceda586-9e73-41fa-ab40-2bd1908dd02a req-4aef55c4-c17a-4fb8-9238-6f0163c5c865 service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:37.585266 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-aceda586-9e73-41fa-ab40-2bd1908dd02a req-4aef55c4-c17a-4fb8-9238-6f0163c5c865 service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:37.585505 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-aceda586-9e73-41fa-ab40-2bd1908dd02a req-4aef55c4-c17a-4fb8-9238-6f0163c5c865 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] No waiting events found dispatching network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:37.586760 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-aceda586-9e73-41fa-ab40-2bd1908dd02a req-4aef55c4-c17a-4fb8-9238-6f0163c5c865 service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received unexpected event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 for instance with vm_state rescued and task_state unrescuing. May 27 21:04:37.674747 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:37.704501 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-1491ed4a-ae5f-4809-8e4f-91f590a64aaa req-32260595-86e9-4357-96b3-afcdbc6124a1 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updated VIF entry in instance network info cache for port bbe00ed4-45d2-4b31-a1c0-aadcf463da83. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:04:37.704700 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-1491ed4a-ae5f-4809-8e4f-91f590a64aaa req-32260595-86e9-4357-96b3-afcdbc6124a1 service nova] [instance: 59971b35-cbb8-420e-a34e-b614819ad555] Updating instance_info_cache with network_info: [{"id": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "address": "fa:16:3e:62:2a:d4", "network": {"id": "2efc5470-da6b-4b9b-8cbc-f8cfb462ec95", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-352678215-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "251237411f6e4bb49303c88852d6e9a1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbe00ed4-45", "ovs_interfaceid": "bbe00ed4-45d2-4b31-a1c0-aadcf463da83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:37.721011 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:04:37.721905 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:04:37.722314 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Creating image(s) May 27 21:04:37.722612 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquiring lock "/opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:37.722783 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "/opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:37.723900 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "/opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:37.724513 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:37.729597 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:37.733764 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Successfully updated port: be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:04:37.734179 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:37.747649 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Unrescuing May 27 21:04:37.751771 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:37.756413 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquired lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:37.756832 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:37.814419 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:04:37.822101 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.state = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:04:37.834071 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:04:37.834071 np0000001553 nova-compute[98213]: # END RECORD May 27 21:04:37.834071 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:37.840329 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.state = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:04:37.840329 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:04:37.840329 np0000001553 nova-compute[98213]: # END RECORD May 27 21:04:37.840329 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:37.846936 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.109s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:37.846936 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:37.846936 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:37.846936 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:37.847928 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:37.848118 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:37.861734 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:37.868423 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:37.888448 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.888448 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.888448 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.888448 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.888448 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:37.888588 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.888588 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.888588 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.888588 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.888588 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:37.893359 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.893359 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.893359 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.893359 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.893359 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:37.893631 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.893631 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.893631 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.893631 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.893631 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:37.910575 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] During sync_power_state the instance has a pending task (unrescuing). Skip. May 27 21:04:37.937324 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5, portal: 192.168.40.100,3260] May 27 21:04:37.937324 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5, portal: 192.168.40.100,3260] successful. May 27 21:04:37.937324 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:37.948230 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5, portal: 192.168.50.100,3260] May 27 21:04:37.948230 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5, portal: 192.168.50.100,3260] successful. May 27 21:04:37.948230 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:37.949824 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.102s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:37.950561 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:37.969923 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:37.972068 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:37.991326 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.991326 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.991326 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.991326 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:37.991326 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:37.991326 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.991326 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:37.991570 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.991570 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.991570 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.991570 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:37.991570 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:37.991570 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.991570 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:37.994298 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.255s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:37.994298 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:04:37.994298 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] HCTL ('10', '-', '-', 0) found on session 37 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:04:37.994298 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:04:37.999566 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.999566 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.999566 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.999566 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:37.999566 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:37.999566 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.999566 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:37.999784 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.999784 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.999784 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:37.999784 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:37.999784 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:37.999784 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:37.999784 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:38.000107 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.264s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:38.000295 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:04:38.001215 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] HCTL ('9', '-', '-', 0) found on session 36 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:04:38.001406 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:04:38.017717 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk 1073741824" returned: 0 in 0.062s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:38.017717 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Searching for a device in session 37 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:04:38.017717 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:04:38.020467 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.175s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:38.020467 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:38.054646 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Searching for a device in session 36 and hctl ['9', '*', '*', 0] yield: sde {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:04:38.057402 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:04:38.168966 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Received event network-vif-plugged-4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:38.170302 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] Acquiring lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:38.171723 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:38.172828 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:38.172828 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] No waiting events found dispatching network-vif-plugged-4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:38.172828 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Received unexpected event network-vif-plugged-4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 for instance with vm_state active and task_state None. May 27 21:04:38.172828 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Received event network-vif-plugged-4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:38.173467 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] Acquiring lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:38.174772 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:38.175731 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:38.175731 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] No waiting events found dispatching network-vif-plugged-4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:38.175731 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-cadcb10b-c015-4e04-b3d5-9176b673d5d6 req-8f6dc43e-f8a8-4e76-8b94-2b60779f3ef6 service nova] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Received unexpected event network-vif-plugged-4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4 for instance with vm_state active and task_state None. May 27 21:04:38.177974 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.157s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:38.179288 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:04:38.179288 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:38.207501 np0000001553 nova-compute[98213]: DEBUG nova.compute.resource_tracker [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Compute_service record updated for np0000001553:np0000001553 {{(pid=98213) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} May 27 21:04:38.209091 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.055s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:38.210162 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-1491ed4a-ae5f-4809-8e4f-91f590a64aaa req-32260595-86e9-4357-96b3-afcdbc6124a1 service nova] Releasing lock "refresh_cache-59971b35-cbb8-420e-a34e-b614819ad555" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:38.211713 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:04:38.259940 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquiring lock "refresh_cache-47a99920-efad-44f2-b7f4-55a90d97f110" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:38.260055 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquired lock "refresh_cache-47a99920-efad-44f2-b7f4-55a90d97f110" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:38.260232 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:38.263413 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:38.287907 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:38.289322 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Cannot resize image /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:04:38.289322 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:04:38.289322 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Ensure instance console log exists: /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:04:38.289322 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:38.289583 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:38.289734 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:38.476729 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005734860001211928 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:38.477090 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:38.477090 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.595962761999999 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:38.477366 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.5957406620000256 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:38.478239 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:38.479257 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] VM Stopped (Lifecycle Event) May 27 21:04:38.480830 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:38.480968 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:38.481093 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] No VIF found with MAC fa:16:3e:d3:8e:b1, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:38.606114 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "a9322d2a-d1ff-4efc-9642-db657de18998" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:38.606471 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a9322d2a-d1ff-4efc-9642-db657de18998" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:38.687987 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:38.745759 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:04:38.877277 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:04:38.889473 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Updating instance_info_cache with network_info: [{"id": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "address": "fa:16:3e:be:44:d9", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2fb2ba7-dd", "ovs_interfaceid": "c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:38.982466 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-940eb64d-1eb4-430e-be5f-d61d888c0ed9 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: f4397c41-4087-4367-b1ac-46e8cc475772] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:38.986639 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1684979265', uuid='c14c8d62-737e-4297-88bf-f9ee3cc16dfa'), owner=OwnerMeta(userid='f824052f16e642148868fa2d1df1f3db', username='tempest-TaggedAttachmentsTest-125489879-project-member', projectid='5d3d950b316142468c97cb18a90f7492', projectname='tempest-TaggedAttachmentsTest-125489879'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0d95369a-dc11-4881-9f34-e4f0b174327b", "address": "fa:16:3e:d3:8e:b1", "network": {"id": "3c9d13a6-e4fd-4368-a23a-a4eb93c46fee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1766662943-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d95369a-dc", "ovs_interfaceid": "0d95369a-dc11-4881-9f34-e4f0b174327b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "address": "fa:16:3e:a8:47:0b", "network": {"id": "955decd4-cb14-477b-915e-e299dd140660", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-601472937", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b216ef0-5d", "ovs_interfaceid": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915878.9856217) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:04:38.986639 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] set metadata xml: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: tempest-device-tagging-server-1684979265 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: 2026-05-27 21:04:38 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: 192 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: 1 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: 0 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: 0 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: 1 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: True May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: bare May 27 21:04:38.986639 np0000001553 nova-compute[98213]: qcow2 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: 1 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: 0 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: ide May 27 21:04:38.986639 np0000001553 nova-compute[98213]: virtio May 27 21:04:38.986639 np0000001553 nova-compute[98213]: pc May 27 21:04:38.986639 np0000001553 nova-compute[98213]: virtio May 27 21:04:38.986639 np0000001553 nova-compute[98213]: virtio May 27 21:04:38.986639 np0000001553 nova-compute[98213]: virtio May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: tempest-TaggedAttachmentsTest-125489879-project-member May 27 21:04:38.986639 np0000001553 nova-compute[98213]: tempest-TaggedAttachmentsTest-125489879 May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: May 27 21:04:38.986639 np0000001553 nova-compute[98213]: {{(pid=98213) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}} May 27 21:04:39.027399 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:39.112493 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:04:39.183526 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Updating instance_info_cache with network_info: [{"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:39.391789 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Releasing lock "refresh_cache-28fe4f34-f07e-4eef-bc7e-59ad5d8adfef" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:39.392031 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'flavor' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:39.493299 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-d49472cd-347e-4e1b-8dfc-3db9ebcf3ec8 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "interface-c14c8d62-737e-4297-88bf-f9ee3cc16dfa-None" "released" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: held 8.962s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:39.649226 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-59f0f6f2-660e-47e6-9d85-29158a71b0e1 req-8a80967b-b79a-4b3c-b9f8-4ede7342caf1 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Received event network-changed-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:39.649368 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-59f0f6f2-660e-47e6-9d85-29158a71b0e1 req-8a80967b-b79a-4b3c-b9f8-4ede7342caf1 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Refreshing instance network info cache due to event network-changed-be0bc3b0-9928-42d5-915a-090a643dbc0d. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:04:39.649834 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-59f0f6f2-660e-47e6-9d85-29158a71b0e1 req-8a80967b-b79a-4b3c-b9f8-4ede7342caf1 service nova] Acquiring lock "refresh_cache-47a99920-efad-44f2-b7f4-55a90d97f110" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:39.670025 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:39.670171 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:39.673763 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:04:39.673763 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Claim successful on node np0000001553 May 27 21:04:39.685862 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Releasing lock "refresh_cache-47a99920-efad-44f2-b7f4-55a90d97f110" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:39.686063 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Instance network_info: |[{"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:04:39.686369 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-59f0f6f2-660e-47e6-9d85-29158a71b0e1 req-8a80967b-b79a-4b3c-b9f8-4ede7342caf1 service nova] Acquired lock "refresh_cache-47a99920-efad-44f2-b7f4-55a90d97f110" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:39.686488 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-59f0f6f2-660e-47e6-9d85-29158a71b0e1 req-8a80967b-b79a-4b3c-b9f8-4ede7342caf1 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Refreshing network info cache for port be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:04:39.689213 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Start _get_guest_xml network_info=[{"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:04:39.693629 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:04:39.696088 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-1564369876', uuid='47a99920-efad-44f2-b7f4-55a90d97f110'), owner=OwnerMeta(userid='14e43424fca24d5d962d1165ffa09c7e', username='tempest-VolumesNegativeTest-1723604863-project-member', projectid='416095e9da0e422fa4a807ed7ad79d66', projectname='tempest-VolumesNegativeTest-1723604863'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915879.6945906) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:04:39.698371 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:04:39.698371 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:04:39.699115 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:04:39.699335 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:04:39.700208 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:04:39.700704 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:04:39.700704 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:04:39.700817 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:04:39.700843 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:04:39.700924 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:04:39.701679 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:04:39.701679 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:04:39.701679 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:04:39.701679 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:04:39.701679 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:04:39.701679 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:04:39.716308 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1564369876',display_name='tempest-VolumesNegativeTest-instance-1564369876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-volumesnegativetest-instance-1564369876',id=23,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='416095e9da0e422fa4a807ed7ad79d66',ramdisk_id='',reservation_id='r-rpz5x7n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1723604863',owner_user_name='tempest-VolumesNegativeTest-1723604863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:37Z,user_data=None,user_id='14e43424fca24d5d962d1165ffa09c7e',uuid=47a99920-efad-44f2-b7f4-55a90d97f110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:04:39.716308 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Converting VIF {"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:39.716557 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:54:96,bridge_name='br-int',has_traffic_filtering=True,id=be0bc3b0-9928-42d5-915a-090a643dbc0d,network=Network(68138658-d116-4b97-9c0c-bee1f14c09b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0bc3b0-99') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:39.717191 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lazy-loading 'pci_devices' on Instance uuid 47a99920-efad-44f2-b7f4-55a90d97f110 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:39.763641 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Found WWN 330000000a7b16fbf for multipath device dm-3 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:04:39.764874 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:39.764874 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000a7b16fbf', 'path': '/dev/dm-3', 'multipath_id': '330000000a7b16fbf'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:39.764874 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a7b16fbf', 'path': '/dev/dm-3', 'multipath_id': '330000000a7b16fbf'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:04:39.768674 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lazy-loading 'flavor' on Instance uuid a9faa280-cc00-4b18-8ef8-a5eb7408d655 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:39.927876 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:39.930802 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:39.957825 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.134342 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.141811 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.190397 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-59f0f6f2-660e-47e6-9d85-29158a71b0e1 req-8a80967b-b79a-4b3c-b9f8-4ede7342caf1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:40.201832 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.207638 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:04:40.207894 np0000001553 nova-compute[98213]: DEBUG oslo_service.periodic_task [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98213) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} May 27 21:04:40.208185 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [None req-36e7f2c3-1e00-481d-9210-c4f6501b9bed None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.45 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:04:40.213245 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.219742 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] End _get_guest_xml xml= May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 47a99920-efad-44f2-b7f4-55a90d97f110 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: instance-00000017 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 196608 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 1 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: tempest-VolumesNegativeTest-instance-1564369876 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 2026-05-27 21:04:39 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 192 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 1 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 0 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 0 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 1 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: True May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: bare May 27 21:04:40.219742 np0000001553 nova-compute[98213]: qcow2 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 1 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 0 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: virtio May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: tempest-VolumesNegativeTest-1723604863-project-member May 27 21:04:40.219742 np0000001553 nova-compute[98213]: tempest-VolumesNegativeTest-1723604863 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:04:40.219742 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 47a99920-efad-44f2-b7f4-55a90d97f110 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 47a99920-efad-44f2-b7f4-55a90d97f110 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: hvm May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 128 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: 1 May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: Nehalem May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: May 27 21:04:40.219742 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:04:40.223874 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Preparing to wait for external event network-vif-plugged-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:04:40.223874 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquiring lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:40.223874 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:40.223874 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:40.223874 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1564369876',display_name='tempest-VolumesNegativeTest-instance-1564369876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-volumesnegativetest-instance-1564369876',id=23,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='416095e9da0e422fa4a807ed7ad79d66',ramdisk_id='',reservation_id='r-rpz5x7n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1723604863',owner_user_name='tempest-VolumesNegativeTest-1723604863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:37Z,user_data=None,user_id='14e43424fca24d5d962d1165ffa09c7e',uuid=47a99920-efad-44f2-b7f4-55a90d97f110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:04:40.224092 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Converting VIF {"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:40.224092 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:54:96,bridge_name='br-int',has_traffic_filtering=True,id=be0bc3b0-9928-42d5-915a-090a643dbc0d,network=Network(68138658-d116-4b97-9c0c-bee1f14c09b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0bc3b0-99') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:40.224092 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:54:96,bridge_name='br-int',has_traffic_filtering=True,id=be0bc3b0-9928-42d5-915a-090a643dbc0d,network=Network(68138658-d116-4b97-9c0c-bee1f14c09b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0bc3b0-99') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:04:40.224092 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.225135 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:40.225135 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:04:40.227041 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.227041 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45e40315-8574-508a-927d-a368019f9304', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:40.227754 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.228840 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:40.232857 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.238095 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.238095 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe0bc3b0-99, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:40.238095 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe0bc3b0-99, col_values=(('qos', UUID('3d316d8b-0d0b-49bb-be0c-32952acef43b')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:40.238095 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe0bc3b0-99, col_values=(('external_ids', {'iface-id': 'be0bc3b0-9928-42d5-915a-090a643dbc0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:54:96', 'vm-uuid': '47a99920-efad-44f2-b7f4-55a90d97f110'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:40.238636 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.241696 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:40.244898 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.99967361600011 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:40.246181 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Instance destroyed successfully. May 27 21:04:40.246585 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'numa_topology' on Instance uuid 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:40.250298 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:40.251631 np0000001553 nova-compute[98213]: INFO os_vif [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:54:96,bridge_name='br-int',has_traffic_filtering=True,id=be0bc3b0-9928-42d5-915a-090a643dbc0d,network=Network(68138658-d116-4b97-9c0c-bee1f14c09b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0bc3b0-99') May 27 21:04:40.270430 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Attempting to attach volume 04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:04:40.274882 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] attach device xml: May 27 21:04:40.274882 np0000001553 nova-compute[98213]: May 27 21:04:40.274882 np0000001553 nova-compute[98213]: May 27 21:04:40.274882 np0000001553 nova-compute[98213]: May 27 21:04:40.274882 np0000001553 nova-compute[98213]: May 27 21:04:40.274882 np0000001553 nova-compute[98213]: 04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 May 27 21:04:40.274882 np0000001553 nova-compute[98213]: May 27 21:04:40.274882 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:04:40.385176 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:40.385521 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:40.525655 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-59f0f6f2-660e-47e6-9d85-29158a71b0e1 req-8a80967b-b79a-4b3c-b9f8-4ede7342caf1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:40.646078 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-59f0f6f2-660e-47e6-9d85-29158a71b0e1 req-8a80967b-b79a-4b3c-b9f8-4ede7342caf1 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Updated VIF entry in instance network info cache for port be0bc3b0-9928-42d5-915a-090a643dbc0d. {{(pid=98213) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} May 27 21:04:40.646329 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-59f0f6f2-660e-47e6-9d85-29158a71b0e1 req-8a80967b-b79a-4b3c-b9f8-4ede7342caf1 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Updating instance_info_cache with network_info: [{"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:40.748296 np0000001553 nova-compute[98213]: DEBUG nova.objects.base [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Object Instance<28fe4f34-f07e-4eef-bc7e-59ad5d8adfef> lazy-loaded attributes: flavor,numa_topology {{(pid=98213) wrapper /opt/stack/nova/nova/objects/base.py:136}} May 27 21:04:40.889526 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lazy-loading 'flavor' on Instance uuid c14c8d62-737e-4297-88bf-f9ee3cc16dfa {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:41.147998 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-59f0f6f2-660e-47e6-9d85-29158a71b0e1 req-8a80967b-b79a-4b3c-b9f8-4ede7342caf1 service nova] Releasing lock "refresh_cache-47a99920-efad-44f2-b7f4-55a90d97f110" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:41.188154 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:41.216973 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:41.314232 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:41.326560 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:41.326791 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:41.354509 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:41.360437 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:41.708519 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:41.709237 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:41.710003 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:41.710003 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:41.710003 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] No waiting events found dispatching network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:41.710003 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received unexpected event network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 for instance with vm_state rescued and task_state unrescuing. May 27 21:04:41.710297 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:41.710412 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:41.710602 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:41.710753 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:41.710912 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] No waiting events found dispatching network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:41.711461 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received unexpected event network-vif-unplugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 for instance with vm_state rescued and task_state unrescuing. May 27 21:04:41.711709 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:41.711907 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:41.712282 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:41.712503 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:41.712653 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] No waiting events found dispatching network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:41.712807 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received unexpected event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 for instance with vm_state rescued and task_state unrescuing. May 27 21:04:41.712957 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:41.713204 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Acquiring lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:41.713345 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:41.713489 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] Lock "28fe4f34-f07e-4eef-bc7e-59ad5d8adfef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:41.713643 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] No waiting events found dispatching network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:41.713786 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-7b2e11ef-ce3b-4ca4-b611-cd61b4bee867 req-ba4f15ec-7162-4c04-9b68-9b450de7138a service nova] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Received unexpected event network-vif-plugged-c2fb2ba7-ddf1-4f11-abf4-b77513d77ec0 for instance with vm_state rescued and task_state unrescuing. May 27 21:04:41.772498 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:41.772613 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:41.772702 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] No VIF found with MAC fa:16:3e:50:54:96, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:41.773084 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Using config drive May 27 21:04:41.829245 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:41.833888 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:41.895024 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.509s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:41.931306 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:41.931472 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:41.931581 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:41.931627 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] No VIF found with MAC fa:16:3e:e5:99:7d, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:41.983571 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Removed pending STOPPED event for 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef due to new event Resumed> {{(pid=98213) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}} May 27 21:04:41.984078 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:41.984402 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] VM Resumed (Lifecycle Event) May 27 21:04:41.985994 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-96155094-276c-4be0-ace9-c7e55fb587d3 tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:42.073395 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003972130000420293 future=) submitted to {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:42.074235 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] Emitting event Stopped> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:42.074363 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:42.074534 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] VM Stopped (Lifecycle Event) May 27 21:04:42.075609 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.7471116889998939 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:42.075713 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=0.7469794849998834 future=) was cancelled while queued, skipping {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:42.075811 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:42.075938 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=13.16859334600008 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:42.076037 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=13.168492209000078 future=) was cancelled while queued, skipping {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:42.076125 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:42.278135 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:42.337270 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.667s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:42.337589 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:04:42.416105 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Creating config drive at /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk.config May 27 21:04:42.419274 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpak3_4rzi {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:42.473070 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpak3_4rzi" returned: 0 in 0.054s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:42.487466 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:42.490494 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:42.577257 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-363f3417-d449-43a2-92af-c9d58d05c8c4 tempest-AttachSCSIVolumeTestJSON-802568575 tempest-AttachSCSIVolumeTestJSON-802568575-project-member] [instance: a8b6e8af-99d6-4ab7-82c7-68af9f22c24f] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:42.844046 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:04:42.844413 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:04:42.844633 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:42.844735 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:42.929222 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:42.945688 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99659c2947e743c899512883f5a85b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b562b6a1ba2b4c3ab101af22f9d04713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:04:42.993167 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:42.993167 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:42.993167 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Attaching volume 098e47f1-ac54-4bda-9678-a903160455b5 to /dev/vdb May 27 21:04:42.993167 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:42.993167 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] VM Started (Lifecycle Event) May 27 21:04:42.996359 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:42.998825 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:42.999949 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:43.060522 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:43.068096 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:43.079479 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:04:43.104702 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:43.158455 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:04:43.159104 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:04:43.166246 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:04:43.168529 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fee5:7025', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fe65:892c', 'fe80::fc16:3eff:fed3:8eb1', 'fe80::8c52:96ff:fe71:ef82', 'fe80::dc70:ecff:feeb:296b', 'fe80::fc16:3eff:fe21:10ec', 'fe80::fc16:3eff:fe62:2ad4', 'fe80::fc16:3eff:fee5:997d', 'fe80::147a:faff:fe2e:4fb2', 'fe80::fc16:3eff:fea8:470b', 'fe80::e822:a7ff:fe3c:fca4', 'fe80::fc16:3eff:febe:44d9', 'fe80::fc16:3eff:fe50:5496', 'fe80::c468:8eff:fec1:5b9d'] May 27 21:04:43.168656 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:04:43.168726 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:04:43.168942 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:43.169232 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Updating existing volume attachment record: 0ad26c29-9a06-48ff-9402-55ba51296485 {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:04:43.310522 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:43.344549 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:43.351848 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:04:43.497414 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:43.504573 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 28fe4f34-f07e-4eef-bc7e-59ad5d8adfef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:43.518021 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-73c807e7-058f-45a9-9cb9-9fe68e5937a0 tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.565s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:43.712922 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Successfully created port: ed85f952-39c4-422f-afd3-fa1c9eec4f97 {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:04:43.734111 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:04:43.735128 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '098e47f1-ac54-4bda-9678-a903160455b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:43.735128 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:43.737547 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:43.737928 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '098e47f1-ac54-4bda-9678-a903160455b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:04:43.757078 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:43.757714 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:43.758215 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:43.758524 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:04:43.759925 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:43.760196 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:04:43.772551 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:04:43.772551 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:43.774520 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Received event network-vif-plugged-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:43.774890 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] Acquiring lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:43.774965 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:43.776494 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:43.776611 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Processing event network-vif-plugged-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:04:43.776776 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Received event network-vif-plugged-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:43.776916 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] Acquiring lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:43.777219 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:43.777470 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:43.777768 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:04:43.777768 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:43.779064 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] No waiting events found dispatching network-vif-plugged-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:43.779303 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-84558fd7-c27d-4e99-ac77-5469a9454769 req-488ac24f-e912-40de-a7a1-c4dc4114fae4 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Received unexpected event network-vif-plugged-be0bc3b0-9928-42d5-915a-090a643dbc0d for instance with vm_state building and task_state spawning. May 27 21:04:43.784465 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5] added May 27 21:04:43.784465 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:04:43.784465 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:43.784465 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:43.784465 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:43.784465 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:43.784465 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:43.784465 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:04:43.784465 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:04:43.784465 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:04:43.788888 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5] added May 27 21:04:43.788888 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:04:43.788888 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:43.788888 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:43.788888 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:43.788888 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:43.788888 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:43.788888 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:04:43.788888 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:04:43.788888 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:04:43.861525 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:04:43.923433 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:43.923609 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:43.923795 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:43.923929 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:43.924034 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:43.927008 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Terminating instance May 27 21:04:43.928448 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:04:43.931043 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:04:43.935466 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Instance spawned successfully. May 27 21:04:43.936809 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:04:44.007541 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:44.007764 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] VM Started (Lifecycle Event) May 27 21:04:44.067575 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:44.366548 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Successfully updated port: ed85f952-39c4-422f-afd3-fa1c9eec4f97 {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:04:44.368265 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Booting with volume 16da3334-4fe3-4e06-aeb8-02f776d8e27c at /dev/vda May 27 21:04:44.419321 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.175', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001553', 'execute': None}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:44.433898 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.scaleio [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98213) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} May 27 21:04:44.435128 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:04:44.438615 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4420d5e5-d2ca-49c6-8e66-8867101a5469 req-10a6ddc6-b4ec-47d4-88e1-d275df5a87eb service nova] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Received event network-changed-ed85f952-39c4-422f-afd3-fa1c9eec4f97 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:44.439972 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-4420d5e5-d2ca-49c6-8e66-8867101a5469 req-10a6ddc6-b4ec-47d4-88e1-d275df5a87eb service nova] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Refreshing instance network info cache due to event network-changed-ed85f952-39c4-422f-afd3-fa1c9eec4f97. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:04:44.439972 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4420d5e5-d2ca-49c6-8e66-8867101a5469 req-10a6ddc6-b4ec-47d4-88e1-d275df5a87eb service nova] Acquiring lock "refresh_cache-a9322d2a-d1ff-4efc-9642-db657de18998" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:44.439972 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4420d5e5-d2ca-49c6-8e66-8867101a5469 req-10a6ddc6-b4ec-47d4-88e1-d275df5a87eb service nova] Acquired lock "refresh_cache-a9322d2a-d1ff-4efc-9642-db657de18998" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:44.439972 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4420d5e5-d2ca-49c6-8e66-8867101a5469 req-10a6ddc6-b4ec-47d4-88e1-d275df5a87eb service nova] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Refreshing network info cache for port ed85f952-39c4-422f-afd3-fa1c9eec4f97 {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:04:44.446354 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:44.447102 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:44.447102 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:44.448081 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:44.448081 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:44.448081 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:44.468436 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:44.468436 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): nvme version {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:44.496803 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:44.512038 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:44.518212 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:44.524264 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:44.527418 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] 'nvme version' failed. Not Retrying. {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} May 27 21:04:44.527789 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] nvme not present on system {{(pid=98213) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} May 27 21:04:44.543448 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98213) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} May 27 21:04:44.546211 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.lightos [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Current host hostNQN and IP(s) are ['10.4.3.175', 'fe80::f816:3eff:fec3:30f4', '192.168.40.6', 'fe80::f816:3eff:fe4a:da3e', '192.168.50.6', 'fe80::f816:3eff:fe14:818a', '192.168.10.6', 'fe80::f816:3eff:fe0d:b946', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::6095:19ff:fe08:2d49', 'fe80::fc16:3eff:fee5:7025', 'fe80::4c23:9dff:fea0:145d', 'fe80::fc16:3eff:fe94:fda2', 'fe80::fcee:45ff:feda:5482', 'fe80::fc16:3eff:fe12:51b6', 'fe80::fc16:3eff:fe9e:340a', 'fe80::fc16:3eff:fe65:892c', 'fe80::fc16:3eff:fed3:8eb1', 'fe80::8c52:96ff:fe71:ef82', 'fe80::dc70:ecff:feeb:296b', 'fe80::fc16:3eff:fe21:10ec', 'fe80::fc16:3eff:fe62:2ad4', 'fe80::fc16:3eff:fea8:470b', 'fe80::e822:a7ff:fe3c:fca4', 'fe80::fc16:3eff:febe:44d9', 'fe80::fc16:3eff:fe50:5496', 'fe80::c468:8eff:fec1:5b9d'] May 27 21:04:44.546211 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} May 27 21:04:44.546211 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] LIGHTOS: no hostnqn found. {{(pid=98213) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} May 27 21:04:44.546848 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.175', 'host': 'np0000001553', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:785f579b69d', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '2a3a3b7f-76de-4583-8ff1-830f427a798c', 'nvme_native_multipath': False} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:44.546944 np0000001553 nova-compute[98213]: DEBUG nova.virt.block_device [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Updating existing volume attachment record: 81816626-9425-4a17-be76-dc25e0e880ce {{(pid=98213) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} May 27 21:04:44.785204 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:04:44.790273 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.state = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:04:44.807252 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:04:44.807252 np0000001553 nova-compute[98213]: # END RECORD May 27 21:04:44.807252 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:44.815969 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.state = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:04:44.815969 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:04:44.815969 np0000001553 nova-compute[98213]: # END RECORD May 27 21:04:44.815969 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:44.819287 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Instance destroyed successfully. May 27 21:04:44.821280 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lazy-loading 'resources' on Instance uuid a9faa280-cc00-4b18-8ef8-a5eb7408d655 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:44.824311 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:44.832336 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:44.843471 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:44.843471 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.843471 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:44.858895 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.858895 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.858895 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.858895 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.858895 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.858895 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.858895 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:44.859169 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.859169 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.859169 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.859169 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.859169 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.859169 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.859169 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:44.869657 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "refresh_cache-a9322d2a-d1ff-4efc-9642-db657de18998" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:44.888927 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5, portal: 192.168.40.100,3260] May 27 21:04:44.888927 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5, portal: 192.168.40.100,3260] successful. May 27 21:04:44.888927 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:44.902075 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:44.910636 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5, portal: 192.168.50.100,3260] May 27 21:04:44.910636 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5, portal: 192.168.50.100,3260] successful. May 27 21:04:44.910636 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:44.921807 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.921807 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.921807 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.921807 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.921807 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.921807 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:44.921807 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:44.921807 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.921807 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:44.922011 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.922011 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.922011 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.922011 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.922011 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.922011 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:44.922011 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:44.922011 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.922011 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:44.922352 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:44.922475 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:04:44.923903 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:44.924760 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] HCTL ('11', '-', '-', 0) found on session 38 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:04:44.925428 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:04:44.945895 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-4420d5e5-d2ca-49c6-8e66-8867101a5469 req-10a6ddc6-b4ec-47d4-88e1-d275df5a87eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:44.953222 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.953222 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.953222 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.953222 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.953222 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.953222 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:44.953222 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:44.953222 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.953222 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:44.953937 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.953937 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.953937 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:44.953937 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.953937 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:44.953937 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:44.953937 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:44.953937 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:44.953937 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:44.954193 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:44.954193 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:04:44.956731 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Took 7.23 seconds to spawn the instance on the hypervisor. May 27 21:04:44.956993 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:44.963160 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Searching for a device in session 38 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:04:44.963160 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '098e47f1-ac54-4bda-9678-a903160455b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:04:44.963359 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] HCTL ('12', '-', '-', 0) found on session 39 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:04:44.963468 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:04:44.978474 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Searching for a device in session 39 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:04:44.980157 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '098e47f1-ac54-4bda-9678-a903160455b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:04:45.020986 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:04:45.021277 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:45.021375 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] VM Paused (Lifecycle Event) May 27 21:04:45.058380 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4420d5e5-d2ca-49c6-8e66-8867101a5469 req-10a6ddc6-b4ec-47d4-88e1-d275df5a87eb service nova] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:04:45.241648 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:45.244476 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-4420d5e5-d2ca-49c6-8e66-8867101a5469 req-10a6ddc6-b4ec-47d4-88e1-d275df5a87eb service nova] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:45.327057 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-315885919',display_name='tempest-DeleteServersTestJSON-server-315885919',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-deleteserverstestjson-server-315885919',id=22,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:04:30Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8120e91cccf1439b93cc5a173791dbe2',ramdisk_id='',reservation_id='r-qmw9t7ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1578533523',owner_user_name='tempest-DeleteServersTestJSON-1578533523-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:04:31Z,user_data=None,user_id='be4a7a374626443b92bdba82619f4fd5',uuid=a9faa280-cc00-4b18-8ef8-a5eb7408d655,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:04:45.327569 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Converting VIF {"id": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "address": "fa:16:3e:e5:99:7d", "network": {"id": "64b7d080-db83-426e-8593-230a09e4926b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-400836343-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8120e91cccf1439b93cc5a173791dbe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9bb40c3-2e", "ovs_interfaceid": "b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:45.328261 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50,network=Network(64b7d080-db83-426e-8593-230a09e4926b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bb40c3-2e') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:45.328579 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50,network=Network(64b7d080-db83-426e-8593-230a09e4926b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bb40c3-2e') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:04:45.330275 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:45.330624 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9bb40c3-2e, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:45.332029 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:45.333512 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:45.334293 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:45.334457 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=baa8578e-7cf5-4825-a5aa-9a66e6b4f0b7) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:45.334931 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:45.335694 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:45.337692 np0000001553 nova-compute[98213]: INFO os_vif [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:99:7d,bridge_name='br-int',has_traffic_filtering=True,id=b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50,network=Network(64b7d080-db83-426e-8593-230a09e4926b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9bb40c3-2e') May 27 21:04:45.339027 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:04:45.339490 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:45.339617 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:45.474410 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Took 13.41 seconds to build instance. May 27 21:04:45.536469 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:45.539806 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Resumed> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:45.539806 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] VM Resumed (Lifecycle Event) May 27 21:04:45.746566 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-4420d5e5-d2ca-49c6-8e66-8867101a5469 req-10a6ddc6-b4ec-47d4-88e1-d275df5a87eb service nova] Releasing lock "refresh_cache-a9322d2a-d1ff-4efc-9642-db657de18998" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:45.747169 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquired lock "refresh_cache-a9322d2a-d1ff-4efc-9642-db657de18998" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:45.747445 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:45.759290 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:04:45.976207 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-ccb77098-816b-4db6-a5cd-0f6d5a5bad15 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "47a99920-efad-44f2-b7f4-55a90d97f110" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.922s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:46.043816 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:46.045687 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:46.245211 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquiring lock "47a99920-efad-44f2-b7f4-55a90d97f110" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:46.245527 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "47a99920-efad-44f2-b7f4-55a90d97f110" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:46.246192 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquiring lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:46.246794 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:46.246979 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:46.252897 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Terminating instance May 27 21:04:46.332383 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:04:46.532444 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Received event network-vif-unplugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:46.532444 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] Acquiring lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:46.532444 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:46.532444 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:46.532444 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] No waiting events found dispatching network-vif-unplugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:46.532444 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Received event network-vif-unplugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:46.532444 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Received event network-vif-unplugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:46.532444 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] Acquiring lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:46.533074 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:46.533891 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:46.534269 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] No waiting events found dispatching network-vif-unplugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:46.534521 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-e36a439b-4ac9-4273-9087-b2f17026d505 req-cd9d3847-fcfd-4574-b7e0-c04416251a29 service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Received event network-vif-unplugged-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:46.547809 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] During sync_power_state the instance has a pending task (deleting). Skip. May 27 21:04:46.548283 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999763582000014 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:46.548740 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999276831000088 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:46.549115 np0000001553 nova-compute[98213]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998879606000173 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:46.554717 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:46.561057 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:46.563208 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:46.692777 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:04:46.693767 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:04:46.694004 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Creating image(s) May 27 21:04:46.695090 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Did not create local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} May 27 21:04:46.696821 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Ensure instance console log exists: /opt/stack/data/nova/instances/a9322d2a-d1ff-4efc-9642-db657de18998/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:04:46.700355 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Updating instance_info_cache with network_info: [{"id": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "address": "fa:16:3e:dc:2a:53", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped85f952-39", "ovs_interfaceid": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:46.701447 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:46.702480 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:46.702654 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:46.760307 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Start destroying the instance on the hypervisor. {{(pid=98213) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} May 27 21:04:46.781852 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:46.784401 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:46.786658 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Found WWN 3300000002da23978 for multipath device dm-4 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:04:46.786658 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:46.786798 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] <== connect_volume: return (3052ms) {'type': 'block', 'scsi_wwn': '3300000002da23978', 'path': '/dev/dm-4', 'multipath_id': '3300000002da23978'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:46.786860 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002da23978', 'path': '/dev/dm-4', 'multipath_id': '3300000002da23978'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:04:46.788238 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.448s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:46.789055 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:04:46.789055 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:04:46.803672 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lazy-loading 'flavor' on Instance uuid c14c8d62-737e-4297-88bf-f9ee3cc16dfa {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:46.818894 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:46.820828 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:46.834671 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:46.834671 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:46.834671 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:46.834671 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:46.834671 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:46.834671 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:46.834671 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:46.834671 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:46.834671 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:46.834870 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:46.834870 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:46.834870 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:46.834870 np0000001553 nova-compute[98213]: tcp: [36] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:46.834870 np0000001553 nova-compute[98213]: tcp: [37] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5 (non-flash) May 27 21:04:46.834870 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:46.834870 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:46.834870 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:46.834870 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:46.835046 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:04:46.835166 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', '36')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:04:46.836416 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5', '37')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:04:46.839005 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Resulting device map defaultdict(. at 0x79ced0381260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5'): ({'sdd'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:04:46.839311 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Removing multipathed devices sde, sdd {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:04:46.839613 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Flush multipath device 330000000a7b16fbf {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:04:46.848733 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:46.850797 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:46.871690 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:04:46.913090 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:04:46.944880 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9776886f-f89a-4077-bb1f-d94e27c0a34d req-1a8928a3-d82c-4ef3-a70e-20a8b3a41f58 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Received event network-vif-unplugged-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:46.945579 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9776886f-f89a-4077-bb1f-d94e27c0a34d req-1a8928a3-d82c-4ef3-a70e-20a8b3a41f58 service nova] Acquiring lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:46.945882 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9776886f-f89a-4077-bb1f-d94e27c0a34d req-1a8928a3-d82c-4ef3-a70e-20a8b3a41f58 service nova] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:46.946052 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-9776886f-f89a-4077-bb1f-d94e27c0a34d req-1a8928a3-d82c-4ef3-a70e-20a8b3a41f58 service nova] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:46.946449 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9776886f-f89a-4077-bb1f-d94e27c0a34d req-1a8928a3-d82c-4ef3-a70e-20a8b3a41f58 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] No waiting events found dispatching network-vif-unplugged-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:46.946509 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-9776886f-f89a-4077-bb1f-d94e27c0a34d req-1a8928a3-d82c-4ef3-a70e-20a8b3a41f58 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Received event network-vif-unplugged-be0bc3b0-9928-42d5-915a-090a643dbc0d for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:46.962672 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:04:46.962864 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:04:46.965485 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:04:46.982375 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:04:46.982375 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:04:46.992866 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:47.036048 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5, portal: 192.168.40.100,3260] May 27 21:04:47.036048 np0000001553 nova-compute[98213]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5, portal: 192.168.40.100,3260] successful. May 27 21:04:47.036048 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:47.053426 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:47.065873 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Starting instance... {{(pid=98213) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} May 27 21:04:47.069478 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:47.096544 np0000001553 nova-compute[98213]: DEBUG nova.utils [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Queued Task(fn=>, remaining_delay=14.999504723999962 future=) {{(pid=98213) _log /opt/stack/nova/nova/utils.py:1500}} May 27 21:04:47.100426 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Instance destroyed successfully. May 27 21:04:47.100978 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lazy-loading 'resources' on Instance uuid 47a99920-efad-44f2-b7f4-55a90d97f110 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:47.116422 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5, portal: 192.168.50.100,3260] May 27 21:04:47.116422 np0000001553 nova-compute[98213]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-04dd25a6-b4c3-40a2-b6e6-58348b09bfd5, portal: 192.168.50.100,3260] successful. May 27 21:04:47.116422 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:47.136110 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:47.137297 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:47.139431 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] <== disconnect_volume: return (1798ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:47.139431 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:04:47.139431 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Deleting instance files /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655_del May 27 21:04:47.139431 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Deletion of /opt/stack/data/nova/instances/a9faa280-cc00-4b18-8ef8-a5eb7408d655_del complete May 27 21:04:47.202531 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Releasing lock "refresh_cache-a9322d2a-d1ff-4efc-9642-db657de18998" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:47.202825 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Instance network_info: |[{"id": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "address": "fa:16:3e:dc:2a:53", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped85f952-39", "ovs_interfaceid": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:04:47.204244 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Start _get_guest_xml network_info=[{"id": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "address": "fa:16:3e:dc:2a:53", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped85f952-39", "ovs_interfaceid": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a9322d2a-d1ff-4efc-9642-db657de18998', 'attached_at': '', 'detached_at': '', 'volume_id': '16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'serial': '16da3334-4fe3-4e06-aeb8-02f776d8e27c'}, 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '81816626-9425-4a17-be76-dc25e0e880ce', 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:04:47.209334 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:04:47.210340 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1215716172', uuid='a9322d2a-d1ff-4efc-9642-db657de18998'), owner=OwnerMeta(userid='99659c2947e743c899512883f5a85b0e', username='tempest-ServerActionsTestOtherA-113699651-project-member', projectid='b562b6a1ba2b4c3ab101af22f9d04713', projectname='tempest-ServerActionsTestOtherA-113699651'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "address": "fa:16:3e:dc:2a:53", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped85f952-39", "ovs_interfaceid": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915887.2099967) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:04:47.211377 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:04:47.211717 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:04:47.213246 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:04:47.213578 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:04:47.216773 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:04:47.217114 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:04:47.217332 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:04:47.217424 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:04:47.217582 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:04:47.217630 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:04:47.217737 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:04:47.217933 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:04:47.218058 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:04:47.218243 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:04:47.218336 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:04:47.218479 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:04:47.229476 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Calling os-brick to attach iSCSI Volume {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} May 27 21:04:47.229879 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:47.229879 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:47.230201 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:47.230376 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} May 27 21:04:47.244502 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:47.246086 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:47.246520 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:47.246520 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:04:47.246971 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:47.247255 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:04:47.263300 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:04:47.263300 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:47.270619 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found May 27 21:04:47.270619 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:47.276696 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c] added May 27 21:04:47.276696 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:04:47.276696 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:47.276696 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:47.276696 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:47.276696 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:47.276696 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:47.279321 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:04:47.279321 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:04:47.279321 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:04:47.284837 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c] added May 27 21:04:47.284837 np0000001553 nova-compute[98213]: stderr=iscsiadm: Config file line 363 does not have value May 27 21:04:47.284837 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:47.284837 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:47.284837 np0000001553 nova-compute[98213]: iscsiadm: Config file line 363 does not have value May 27 21:04:47.284837 np0000001553 nova-compute[98213]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' May 27 21:04:47.284837 np0000001553 nova-compute[98213]: {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:47.285231 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98213) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} May 27 21:04:47.285270 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} May 27 21:04:47.285468 np0000001553 nova-compute[98213]: DEBUG os_brick.utils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98213) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} May 27 21:04:47.307370 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Attempting to attach volume 098e47f1-ac54-4bda-9678-a903160455b5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98213) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} May 27 21:04:47.311960 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] attach device xml: May 27 21:04:47.311960 np0000001553 nova-compute[98213]: May 27 21:04:47.311960 np0000001553 nova-compute[98213]: May 27 21:04:47.311960 np0000001553 nova-compute[98213]: May 27 21:04:47.311960 np0000001553 nova-compute[98213]: May 27 21:04:47.311960 np0000001553 nova-compute[98213]: 098e47f1-ac54-4bda-9678-a903160455b5 May 27 21:04:47.311960 np0000001553 nova-compute[98213]: May 27 21:04:47.311960 np0000001553 nova-compute[98213]: {{(pid=98213) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} May 27 21:04:47.605934 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:04:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1564369876',display_name='tempest-VolumesNegativeTest-instance-1564369876',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-volumesnegativetest-instance-1564369876',id=23,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-05-27T21:04:44Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='416095e9da0e422fa4a807ed7ad79d66',ramdisk_id='',reservation_id='r-rpz5x7n9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1723604863',owner_user_name='tempest-VolumesNegativeTest-1723604863-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:04:45Z,user_data=None,user_id='14e43424fca24d5d962d1165ffa09c7e',uuid=47a99920-efad-44f2-b7f4-55a90d97f110,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} May 27 21:04:47.606222 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Converting VIF {"id": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "address": "fa:16:3e:50:54:96", "network": {"id": "68138658-d116-4b97-9c0c-bee1f14c09b8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ab239bcc1f08484389cba2a5a08ec59c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe0bc3b0-99", "ovs_interfaceid": "be0bc3b0-9928-42d5-915a-090a643dbc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:47.607186 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:54:96,bridge_name='br-int',has_traffic_filtering=True,id=be0bc3b0-9928-42d5-915a-090a643dbc0d,network=Network(68138658-d116-4b97-9c0c-bee1f14c09b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0bc3b0-99') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:47.607434 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:54:96,bridge_name='br-int',has_traffic_filtering=True,id=be0bc3b0-9928-42d5-915a-090a643dbc0d,network=Network(68138658-d116-4b97-9c0c-bee1f14c09b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0bc3b0-99') {{(pid=98213) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} May 27 21:04:47.608110 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:47.608365 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe0bc3b0-99, bridge=br-int, if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:47.611067 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:47.611067 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:47.611889 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:47.612033 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d316d8b-0d0b-49bb-be0c-32952acef43b) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:47.613742 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:47.613742 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:47.614257 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:47.619312 np0000001553 nova-compute[98213]: INFO os_vif [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:54:96,bridge_name='br-int',has_traffic_filtering=True,id=be0bc3b0-9928-42d5-915a-090a643dbc0d,network=Network(68138658-d116-4b97-9c0c-bee1f14c09b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe0bc3b0-99') May 27 21:04:47.619922 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Deleting instance files /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110_del May 27 21:04:47.620288 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Deletion of /opt/stack/data/nova/instances/47a99920-efad-44f2-b7f4-55a90d97f110_del complete May 27 21:04:47.649158 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Took 3.21 seconds to destroy the instance on the hypervisor. May 27 21:04:47.651102 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:04:47.651102 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:04:47.651102 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:04:47.651102 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:47.657094 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:47.658518 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:47.664969 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98213) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} May 27 21:04:47.666836 np0000001553 nova-compute[98213]: INFO nova.compute.claims [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Claim successful on node np0000001553 May 27 21:04:47.797760 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:48.128195 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Took 1.37 seconds to destroy the instance on the hypervisor. May 27 21:04:48.128971 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._common.loopingcall [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98213) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} May 27 21:04:48.129099 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [-] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Deallocating network for instance {{(pid=98213) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} May 27 21:04:48.129213 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] deallocate_for_instance() {{(pid=98213) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} May 27 21:04:48.129417 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:48.231891 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:48.277759 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 May 27 21:04:48.286389 np0000001553 nova-compute[98213]: INFO os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.state = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.50.100 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:04:48.298005 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:04:48.298005 np0000001553 nova-compute[98213]: # END RECORD May 27 21:04:48.298005 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:48.305986 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.name = iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.tpgt = -1 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.startup = manual May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.leading_login = No May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.iscsi_ifacename = default May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.net_ifacename = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.ipaddress = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.prefix_len = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.hwaddress = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.transport_name = tcp May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.initiatorname = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.state = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.vlan_id = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.vlan_priority = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.vlan_state = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.iface_num = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.mtu = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.port = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.bootproto = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.subnet_mask = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.gateway = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id_state = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.dhcp_alt_client_id = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.dhcp_dns = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.dhcp_learn_iqn = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.dhcp_req_vendor_id_state = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id_state = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.dhcp_vendor_id = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.dhcp_slp_da = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.fragmentation = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.gratuitous_arp = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.incoming_forwarding = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.tos_state = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.tos = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.ttl = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.delayed_ack = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.tcp_nagle = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.tcp_wsf_state = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.tcp_wsf = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.tcp_timer_scale = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.tcp_timestamp = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.redirect = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.def_task_mgmt_timeout = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.header_digest = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.data_digest = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.immediate_data = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.initial_r2t = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.data_seq_inorder = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.data_pdu_inorder = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.erl = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.max_receive_data_len = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.first_burst_len = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.max_outstanding_r2t = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.max_burst_len = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.chap_auth = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.bidi_chap = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.strict_login_compliance = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.discovery_auth = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: iface.discovery_logout = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.discovery_address = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.discovery_port = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.discovery_type = fw May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.initial_cmdsn = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.initial_login_retry_max = 8 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.xmit_thread_priority = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.cmds_max = 128 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.queue_depth = 32 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.nr_sessions = 1 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.auth.authmethod = None May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.auth.username = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.auth.password = *** May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.auth.username_in = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.auth.password_in = May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.auth.chap_algs = SHA256 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.timeo.replacement_timeout = 120 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.err_timeo.abort_timeout = 15 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.err_timeo.lu_reset_timeout = 30 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.err_timeo.tgt_reset_timeout = 30 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.err_timeo.host_reset_timeout = 60 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.iscsi.FastAbort = Yes May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.iscsi.InitialR2T = No May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.iscsi.ImmediateData = Yes May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.iscsi.FirstBurstLength = 262144 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.iscsi.MaxBurstLength = 16776192 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Retain = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.iscsi.DefaultTime2Wait = 2 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.iscsi.MaxConnections = 1 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.iscsi.MaxOutstandingR2T = 1 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.iscsi.ERL = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.scan = auto May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.session.reopen_max = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].address = 192.168.40.100 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].port = 3260 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].startup = manual May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].tcp.window_size = 524288 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].tcp.type_of_service = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].timeo.logout_timeout = 15 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].timeo.login_timeout = 15 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].timeo.auth_timeout = 45 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_interval = 5 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].timeo.noop_out_timeout = 5 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].iscsi.HeaderDigest = None May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].iscsi.DataDigest = None May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].iscsi.IFMarker = No May 27 21:04:48.305986 np0000001553 nova-compute[98213]: node.conn[0].iscsi.OFMarker = No May 27 21:04:48.305986 np0000001553 nova-compute[98213]: # END RECORD May 27 21:04:48.305986 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:48.315690 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:48.322186 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:48.331045 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.331045 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.331045 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.331045 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.331045 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.331045 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.331045 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:48.331325 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.331325 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.331325 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.331325 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.331325 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.331325 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.331325 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:48.341166 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:48.341166 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.341166 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:48.370176 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c, portal: 192.168.50.100,3260] May 27 21:04:48.370176 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c, portal: 192.168.50.100,3260] successful. May 27 21:04:48.370176 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:48.389681 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:48.391413 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c, portal: 192.168.40.100,3260] May 27 21:04:48.391413 np0000001553 nova-compute[98213]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c, portal: 192.168.40.100,3260] successful. May 27 21:04:48.391413 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:48.406783 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:48.415744 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.415744 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.415744 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.415744 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.415744 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.415744 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.415744 np0000001553 nova-compute[98213]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:48.415744 np0000001553 nova-compute[98213]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:48.415744 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:48.416045 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.416045 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.416045 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.416045 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.416045 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.416045 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.416045 np0000001553 nova-compute[98213]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:48.416045 np0000001553 nova-compute[98213]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:48.416045 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:48.417156 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:48.417156 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to 192.168.50.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:04:48.417844 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] HCTL ('9', '-', '-', 0) found on session 40 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:04:48.417999 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:04:48.422596 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.422596 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.422596 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.422596 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.422596 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.422596 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.422596 np0000001553 nova-compute[98213]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:48.422596 np0000001553 nova-compute[98213]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:48.422596 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:48.422755 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.422755 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.422755 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:48.422755 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.422755 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:48.422755 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:48.422755 np0000001553 nova-compute[98213]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:48.422755 np0000001553 nova-compute[98213]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:48.422755 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:48.422982 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:48.423032 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to 192.168.40.100:3260 {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} May 27 21:04:48.423854 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] HCTL ('10', '-', '-', 0) found on session 41 with lun 0 {{(pid=98213) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} May 27 21:04:48.423951 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98213) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} May 27 21:04:48.445425 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching for a device in session 41 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:04:48.445425 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:04:48.446545 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Searching for a device in session 40 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98213) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} May 27 21:04:48.446702 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '16da3334-4fe3-4e06-aeb8-02f776d8e27c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98213) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} May 27 21:04:48.641856 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ff624d49-b04d-45bf-a1fe-864639095243 req-f590573d-fcad-48da-a5c5-7e699fdc7939 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Received event network-vif-deleted-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:48.642771 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-ff624d49-b04d-45bf-a1fe-864639095243 req-f590573d-fcad-48da-a5c5-7e699fdc7939 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Neutron deleted interface be0bc3b0-9928-42d5-915a-090a643dbc0d; detaching it from the instance and deleting it from the info cache May 27 21:04:48.644751 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ff624d49-b04d-45bf-a1fe-864639095243 req-f590573d-fcad-48da-a5c5-7e699fdc7939 service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Detach interface failed, port_id=be0bc3b0-9928-42d5-915a-090a643dbc0d, reason: Instance 47a99920-efad-44f2-b7f4-55a90d97f110 could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:04:48.999176 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:48.999499 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:48.999701 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] No VIF found with MAC fa:16:3e:d3:8e:b1, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:49.010503 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:49.042904 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-01b3cba2-fb7f-4e52-b0c8-f0389a27d132 req-df9514a1-8502-47fd-898b-a13e253f4b7c service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Received event network-vif-unplugged-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:49.043124 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-01b3cba2-fb7f-4e52-b0c8-f0389a27d132 req-df9514a1-8502-47fd-898b-a13e253f4b7c service nova] Acquiring lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:49.046850 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-01b3cba2-fb7f-4e52-b0c8-f0389a27d132 req-df9514a1-8502-47fd-898b-a13e253f4b7c service nova] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:49.046850 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-01b3cba2-fb7f-4e52-b0c8-f0389a27d132 req-df9514a1-8502-47fd-898b-a13e253f4b7c service nova] Lock "47a99920-efad-44f2-b7f4-55a90d97f110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:49.046850 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-01b3cba2-fb7f-4e52-b0c8-f0389a27d132 req-df9514a1-8502-47fd-898b-a13e253f4b7c service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] No waiting events found dispatching network-vif-unplugged-be0bc3b0-9928-42d5-915a-090a643dbc0d {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:49.046850 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-01b3cba2-fb7f-4e52-b0c8-f0389a27d132 req-df9514a1-8502-47fd-898b-a13e253f4b7c service nova] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Received event network-vif-unplugged-be0bc3b0-9928-42d5-915a-090a643dbc0d for instance with task_state deleting. {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} May 27 21:04:49.046850 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-01b3cba2-fb7f-4e52-b0c8-f0389a27d132 req-df9514a1-8502-47fd-898b-a13e253f4b7c service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Received event network-vif-deleted-b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:49.046850 np0000001553 nova-compute[98213]: INFO nova.compute.manager [req-01b3cba2-fb7f-4e52-b0c8-f0389a27d132 req-df9514a1-8502-47fd-898b-a13e253f4b7c service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Neutron deleted interface b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50; detaching it from the instance and deleting it from the info cache May 27 21:04:49.047282 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [-] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:49.050746 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-01b3cba2-fb7f-4e52-b0c8-f0389a27d132 req-df9514a1-8502-47fd-898b-a13e253f4b7c service nova] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Detach interface failed, port_id=b9bb40c3-2e9a-4050-a88c-7e0a0a1ceb50, reason: Instance a9faa280-cc00-4b18-8ef8-a5eb7408d655 could not be found. {{(pid=98213) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} May 27 21:04:49.247088 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} May 27 21:04:49.359813 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:49.360221 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:49.514525 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Took 1.86 seconds to deallocate network for instance. May 27 21:04:49.551927 np0000001553 nova-compute[98213]: INFO nova.compute.manager [-] [instance: 47a99920-efad-44f2-b7f4-55a90d97f110] Took 1.42 seconds to deallocate network for instance. May 27 21:04:49.863977 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:50.061331 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:50.087824 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] [instance: a9faa280-cc00-4b18-8ef8-a5eb7408d655] Took 0.57 seconds to detach 1 volumes for instance. May 27 21:04:50.125128 np0000001553 nova-compute[98213]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98213) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} May 27 21:04:50.262805 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Found WWN 330000000311b063a for multipath device dm-3 {{(pid=98213) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} May 27 21:04:50.262805 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:50.262805 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000311b063a', 'path': '/dev/dm-3', 'multipath_id': '330000000311b063a'} {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:50.262805 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000311b063a', 'path': '/dev/dm-3', 'multipath_id': '330000000311b063a'} {{(pid=98213) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} May 27 21:04:50.370074 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.712s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:50.370571 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.309s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:50.370729 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Start building networks asynchronously for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} May 27 21:04:50.561899 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-84eecc6a-8f2f-42d7-9824-c3891db17d49 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.571s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:50.594441 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:50.770221 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1215716172',display_name='tempest-ServerActionsTestOtherA-server-1215716172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serveractionstestothera-server-1215716172',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEInSa8JrI1dfU7W+wLBPp0KWlcMNw6TBf93sf5arFwnFDMTf+oJ7sbOGBI1G87lQprSsk546XKRK37v0D6J+U6P0PeE2dVv2emGZ8L1bvjaexP3+OSahzZ8++QAwEAX8w==',key_name='tempest-keypair-1977253916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b562b6a1ba2b4c3ab101af22f9d04713',ramdisk_id='',reservation_id='r-xxn42070',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-113699651',owner_user_name='tempest-ServerActionsTestOtherA-113699651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99659c2947e743c899512883f5a85b0e',uuid=a9322d2a-d1ff-4efc-9642-db657de18998,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "address": "fa:16:3e:dc:2a:53", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped85f952-39", "ovs_interfaceid": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:04:50.770221 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converting VIF {"id": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "address": "fa:16:3e:dc:2a:53", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped85f952-39", "ovs_interfaceid": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:50.770221 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=ed85f952-39c4-422f-afd3-fa1c9eec4f97,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85f952-39') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:50.770668 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lazy-loading 'pci_devices' on Instance uuid a9322d2a-d1ff-4efc-9642-db657de18998 {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:50.879411 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Allocating IP information in the background. {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} May 27 21:04:50.880085 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] allocate_for_instance() {{(pid=98213) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} May 27 21:04:50.880392 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:50.880672 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:50.994603 np0000001553 nova-compute[98213]: DEBUG nova.policy [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc3a4342c86f437986a3c05ea178bec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1acfdacf68cd433a94e1b4e91cfc6ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98213) authorize /opt/stack/nova/nova/policy.py:192}} May 27 21:04:51.026107 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:51.026444 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:51.277166 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] End _get_guest_xml xml= May 27 21:04:51.277166 np0000001553 nova-compute[98213]: a9322d2a-d1ff-4efc-9642-db657de18998 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: instance-00000018 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 196608 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 1 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-server-1215716172 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 2026-05-27 21:04:47 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 192 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 1 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 0 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 0 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 1 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: True May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 1 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 0 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: virtio May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-113699651-project-member May 27 21:04:51.277166 np0000001553 nova-compute[98213]: tempest-ServerActionsTestOtherA-113699651 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:04:51.277166 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: a9322d2a-d1ff-4efc-9642-db657de18998 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: a9322d2a-d1ff-4efc-9642-db657de18998 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: hvm May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 128 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 1 May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: Nehalem May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: 16da3334-4fe3-4e06-aeb8-02f776d8e27c May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: May 27 21:04:51.277166 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:04:51.277166 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Preparing to wait for external event network-vif-plugged-ed85f952-39c4-422f-afd3-fa1c9eec4f97 {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:04:51.277166 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Acquiring lock "a9322d2a-d1ff-4efc-9642-db657de18998-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:51.277166 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a9322d2a-d1ff-4efc-9642-db657de18998-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:51.277166 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Lock "a9322d2a-d1ff-4efc-9642-db657de18998-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:51.286958 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1215716172',display_name='tempest-ServerActionsTestOtherA-server-1215716172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serveractionstestothera-server-1215716172',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEInSa8JrI1dfU7W+wLBPp0KWlcMNw6TBf93sf5arFwnFDMTf+oJ7sbOGBI1G87lQprSsk546XKRK37v0D6J+U6P0PeE2dVv2emGZ8L1bvjaexP3+OSahzZ8++QAwEAX8w==',key_name='tempest-keypair-1977253916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b562b6a1ba2b4c3ab101af22f9d04713',ramdisk_id='',reservation_id='r-xxn42070',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-113699651',owner_user_name='tempest-ServerActionsTestOtherA-113699651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99659c2947e743c899512883f5a85b0e',uuid=a9322d2a-d1ff-4efc-9642-db657de18998,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "address": "fa:16:3e:dc:2a:53", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped85f952-39", "ovs_interfaceid": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:04:51.286958 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converting VIF {"id": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "address": "fa:16:3e:dc:2a:53", "network": {"id": "5cce899d-45f1-4e6b-a853-b352ee74dd7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1147673585-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b562b6a1ba2b4c3ab101af22f9d04713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped85f952-39", "ovs_interfaceid": "ed85f952-39c4-422f-afd3-fa1c9eec4f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:51.286958 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=ed85f952-39c4-422f-afd3-fa1c9eec4f97,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85f952-39') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:51.288747 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=ed85f952-39c4-422f-afd3-fa1c9eec4f97,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85f952-39') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:04:51.288747 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:51.288747 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:51.288747 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:04:51.288747 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:51.288747 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2c06305-114b-5684-a66d-56beac4bfa29', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:51.290433 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:51.291169 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:51.291591 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:51.295485 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:51.295641 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped85f952-39, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:51.297334 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped85f952-39, col_values=(('qos', UUID('1e5aa1b3-8611-4ce1-bb99-f9999fc21c56')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:51.297334 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped85f952-39, col_values=(('external_ids', {'iface-id': 'ed85f952-39c4-422f-afd3-fa1c9eec4f97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:2a:53', 'vm-uuid': 'a9322d2a-d1ff-4efc-9642-db657de18998'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:51.297553 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:51.299511 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:51.304905 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:51.305892 np0000001553 nova-compute[98213]: INFO os_vif [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=ed85f952-39c4-422f-afd3-fa1c9eec4f97,network=Network(5cce899d-45f1-4e6b-a853-b352ee74dd7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped85f952-39') May 27 21:04:51.384790 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names May 27 21:04:51.530236 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:51.585241 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Successfully created port: f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f {{(pid=98213) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} May 27 21:04:51.859826 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:51.887719 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Start building block device mappings for instance. {{(pid=98213) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} May 27 21:04:52.043912 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.674s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:52.047490 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.452s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:52.116365 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Deleted allocations for instance 47a99920-efad-44f2-b7f4-55a90d97f110 May 27 21:04:52.210724 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Successfully updated port: f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f {{(pid=98213) _update_port /opt/stack/nova/nova/network/neutron.py:569}} May 27 21:04:52.249783 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:52.250167 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:52.270086 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-95df98c1-b0b7-4f0a-a534-9e8f848f0c54 req-f555f311-6a87-46cc-9dc2-ba81b47fc5a9 service nova] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Received event network-changed-f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:52.270301 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-95df98c1-b0b7-4f0a-a534-9e8f848f0c54 req-f555f311-6a87-46cc-9dc2-ba81b47fc5a9 service nova] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Refreshing instance network info cache due to event network-changed-f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f. {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} May 27 21:04:52.270467 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-95df98c1-b0b7-4f0a-a534-9e8f848f0c54 req-f555f311-6a87-46cc-9dc2-ba81b47fc5a9 service nova] Acquiring lock "refresh_cache-9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:52.270575 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-95df98c1-b0b7-4f0a-a534-9e8f848f0c54 req-f555f311-6a87-46cc-9dc2-ba81b47fc5a9 service nova] Acquired lock "refresh_cache-9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:52.270686 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-95df98c1-b0b7-4f0a-a534-9e8f848f0c54 req-f555f311-6a87-46cc-9dc2-ba81b47fc5a9 service nova] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Refreshing network info cache for port f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} May 27 21:04:52.678006 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98213) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} May 27 21:04:52.678463 np0000001553 nova-compute[98213]: DEBUG nova.compute.provider_tree [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Inventory has not changed in ProviderTree for provider: 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 {{(pid=98213) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} May 27 21:04:52.712894 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "refresh_cache-9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} May 27 21:04:52.752717 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Detaching volume 098e47f1-ac54-4bda-9678-a903160455b5 May 27 21:04:52.775284 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [req-95df98c1-b0b7-4f0a-a534-9e8f848f0c54 req-f555f311-6a87-46cc-9dc2-ba81b47fc5a9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:52.794102 np0000001553 nova-compute[98213]: INFO nova.virt.block_device [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Attempting to driver detach volume 098e47f1-ac54-4bda-9678-a903160455b5 from mountpoint /dev/vdb May 27 21:04:52.802693 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Found disk vdb by alias ua-098e47f1-ac54-4bda-9678-a903160455b5 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:04:52.803757 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Found disk vdb by alias ua-098e47f1-ac54-4bda-9678-a903160455b5 {{(pid=98213) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} May 27 21:04:52.803896 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Attempting to detach device vdb from instance c14c8d62-737e-4297-88bf-f9ee3cc16dfa from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:04:52.804417 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] detach device xml: May 27 21:04:52.804417 np0000001553 nova-compute[98213]: May 27 21:04:52.804417 np0000001553 nova-compute[98213]: May 27 21:04:52.804417 np0000001553 nova-compute[98213]: May 27 21:04:52.804417 np0000001553 nova-compute[98213]: May 27 21:04:52.804417 np0000001553 nova-compute[98213]: 098e47f1-ac54-4bda-9678-a903160455b5 May 27 21:04:52.804417 np0000001553 nova-compute[98213]:
May 27 21:04:52.804417 np0000001553 nova-compute[98213]: May 27 21:04:52.804417 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:04:52.810039 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Successfully detached device vdb from instance c14c8d62-737e-4297-88bf-f9ee3cc16dfa from the persistent domain config. May 27 21:04:52.810245 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] (1/8): Attempting to detach device vdb with device alias ua-098e47f1-ac54-4bda-9678-a903160455b5 from instance c14c8d62-737e-4297-88bf-f9ee3cc16dfa from the live domain config. {{(pid=98213) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} May 27 21:04:52.810521 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] detach device xml: May 27 21:04:52.810521 np0000001553 nova-compute[98213]: May 27 21:04:52.810521 np0000001553 nova-compute[98213]: May 27 21:04:52.810521 np0000001553 nova-compute[98213]: May 27 21:04:52.810521 np0000001553 nova-compute[98213]: May 27 21:04:52.810521 np0000001553 nova-compute[98213]: 098e47f1-ac54-4bda-9678-a903160455b5 May 27 21:04:52.810521 np0000001553 nova-compute[98213]:
May 27 21:04:52.810521 np0000001553 nova-compute[98213]: May 27 21:04:52.810521 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:04:52.831076 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:52.831076 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98213) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} May 27 21:04:52.831076 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] No VIF found with MAC fa:16:3e:dc:2a:53, not building metadata {{(pid=98213) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} May 27 21:04:52.831076 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Using config drive May 27 21:04:52.843832 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-95df98c1-b0b7-4f0a-a534-9e8f848f0c54 req-f555f311-6a87-46cc-9dc2-ba81b47fc5a9 service nova] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:04:52.899927 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Start spawning the instance on the hypervisor. {{(pid=98213) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} May 27 21:04:52.903159 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Creating instance directory {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} May 27 21:04:52.903434 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Creating image(s) May 27 21:04:52.904198 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:52.904352 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "/opt/stack/data/nova/instances/9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:52.904782 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "/opt/stack/data/nova/instances/9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:52.909711 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:52.918478 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:52.924517 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:53.024393 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.100s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:53.024920 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:53.025512 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:53.026009 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:53.031113 np0000001553 nova-compute[98213]: DEBUG oslo_utils.imageutils.format_inspector [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98213) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}} May 27 21:04:53.031113 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:53.054892 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [req-95df98c1-b0b7-4f0a-a534-9e8f848f0c54 req-f555f311-6a87-46cc-9dc2-ba81b47fc5a9 service nova] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Updating instance_info_cache with network_info: [] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:53.117469 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.088s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:53.118067 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d/disk 1073741824 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:53.144118 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-f767d1dc-544c-44af-80b2-2083ceefdfe4 tempest-VolumesNegativeTest-1723604863 tempest-VolumesNegativeTest-1723604863-project-member] Lock "47a99920-efad-44f2-b7f4-55a90d97f110" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.898s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:53.176591 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f,backing_fmt=raw /opt/stack/data/nova/instances/9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d/disk 1073741824" returned: 0 in 0.058s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:53.177207 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "2b4df30eb87d6871429072ac02dbbb4631c4b97f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.152s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:53.177482 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:53.190737 np0000001553 nova-compute[98213]: DEBUG nova.scheduler.client.report [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Inventory has not changed for provider 486c0dc2-4a11-4ae8-b90f-d5afcfe85804 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98213) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} May 27 21:04:53.275516 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b4df30eb87d6871429072ac02dbbb4631c4b97f --force-share --output=json" returned: 0 in 0.097s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:53.275928 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d/disk. size=1073741824 {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} May 27 21:04:53.276259 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d/disk --force-share --output=json {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:53.339538 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:53.370298 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Received event ua-098e47f1-ac54-4bda-9678-a903160455b5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98213) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} May 27 21:04:53.371936 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-098e47f1-ac54-4bda-9678-a903160455b5 for instance c14c8d62-737e-4297-88bf-f9ee3cc16dfa {{(pid=98213) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} May 27 21:04:53.375783 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:53.377321 np0000001553 nova-compute[98213]: DEBUG nova.virt.disk.api [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Cannot resize image /opt/stack/data/nova/instances/9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d/disk to a smaller size. {{(pid=98213) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} May 27 21:04:53.377321 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Created local disks {{(pid=98213) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} May 27 21:04:53.377321 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Ensure instance console log exists: /opt/stack/data/nova/instances/9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d/console.log {{(pid=98213) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} May 27 21:04:53.377321 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:53.377321 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:53.377321 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:53.378378 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Successfully detached device vdb from instance c14c8d62-737e-4297-88bf-f9ee3cc16dfa from the live domain config. May 27 21:04:53.379127 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] calling os-brick to detach iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} May 27 21:04:53.379579 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '098e47f1-ac54-4bda-9678-a903160455b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} May 27 21:04:53.380744 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} May 27 21:04:53.380744 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} May 27 21:04:53.380744 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '098e47f1-ac54-4bda-9678-a903160455b5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} May 27 21:04:53.380744 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', 0)] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} May 27 21:04:53.423046 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} May 27 21:04:53.423046 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3 (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5 (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c (non-flash) May 27 21:04:53.423046 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} May 27 21:04:53.423046 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be08ca87-a220-43b1-a6c7-12e3d06fb4d3', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a346f346-41a8-46af-b859-272aacc21f6b', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-16da3334-4fe3-4e06-aeb8-02f776d8e27c', '41')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} May 27 21:04:53.423046 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', '38')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:04:53.423046 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5', '39')] {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} May 27 21:04:53.423046 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Resulting device map defaultdict(. at 0x79ced0381f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5'): ({'sdg'}, set())}) {{(pid=98213) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} May 27 21:04:53.423651 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Removing multipathed devices sdf, sdg {{(pid=98213) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} May 27 21:04:53.423651 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Flush multipath device 3300000002da23978 {{(pid=98213) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} May 27 21:04:53.460830 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:04:53.510987 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Creating config drive at /opt/stack/data/nova/instances/a9322d2a-d1ff-4efc-9642-db657de18998/disk.config May 27 21:04:53.511890 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98213) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} May 27 21:04:53.516370 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a9322d2a-d1ff-4efc-9642-db657de18998/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp4e3h715 {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} May 27 21:04:53.559884 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} May 27 21:04:53.561283 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-95df98c1-b0b7-4f0a-a534-9e8f848f0c54 req-f555f311-6a87-46cc-9dc2-ba81b47fc5a9 service nova] Releasing lock "refresh_cache-9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:53.565413 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98213) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} May 27 21:04:53.565918 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquired lock "refresh_cache-9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} May 27 21:04:53.567093 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Building network info cache for instance {{(pid=98213) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} May 27 21:04:53.569873 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} May 27 21:04:53.582553 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.linuxscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98213) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} May 27 21:04:53.582553 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5')] {{(pid=98213) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} May 27 21:04:53.591776 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.processutils [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a9322d2a-d1ff-4efc-9642-db657de18998/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp4e3h715" returned: 0 in 0.075s {{(pid=98213) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} May 27 21:04:53.594129 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:53.632830 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5, portal: 192.168.40.100,3260] May 27 21:04:53.632830 np0000001553 nova-compute[98213]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5, portal: 192.168.40.100,3260] successful. May 27 21:04:53.632830 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:53.649481 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:53.662113 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:53.700982 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5, portal: 192.168.50.100,3260] May 27 21:04:53.700982 np0000001553 nova-compute[98213]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-098e47f1-ac54-4bda-9678-a903160455b5, portal: 192.168.50.100,3260] successful. May 27 21:04:53.700982 np0000001553 nova-compute[98213]: stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:53.703903 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.658s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:53.726587 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98213) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} May 27 21:04:53.726956 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.base [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} May 27 21:04:53.727047 np0000001553 nova-compute[98213]: DEBUG os_brick.initiator.connectors.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] <== disconnect_volume: return (347ms) None {{(pid=98213) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} May 27 21:04:53.727129 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] [instance: c14c8d62-737e-4297-88bf-f9ee3cc16dfa] Disconnected iSCSI Volume {{(pid=98213) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} May 27 21:04:53.777301 np0000001553 nova-compute[98213]: INFO nova.scheduler.client.report [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Deleted allocations for instance a9faa280-cc00-4b18-8ef8-a5eb7408d655 May 27 21:04:54.093457 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:54.128217 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:54.131690 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:54.175951 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Instance cache missing network info. {{(pid=98213) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} May 27 21:04:54.230374 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:54.278852 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:54.280349 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:54.308100 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lazy-loading 'flavor' on Instance uuid c14c8d62-737e-4297-88bf-f9ee3cc16dfa {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:54.369866 np0000001553 nova-compute[98213]: WARNING neutronclient.v2_0.client [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. May 27 21:04:54.382722 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-55c0af3e-0409-486d-99f1-13f4292fa79f req-cf3d6264-d514-46c5-b538-9335148f3790 service nova] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Received event network-vif-plugged-ed85f952-39c4-422f-afd3-fa1c9eec4f97 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:54.383032 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-55c0af3e-0409-486d-99f1-13f4292fa79f req-cf3d6264-d514-46c5-b538-9335148f3790 service nova] Acquiring lock "a9322d2a-d1ff-4efc-9642-db657de18998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:54.383806 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-55c0af3e-0409-486d-99f1-13f4292fa79f req-cf3d6264-d514-46c5-b538-9335148f3790 service nova] Lock "a9322d2a-d1ff-4efc-9642-db657de18998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:54.384034 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-55c0af3e-0409-486d-99f1-13f4292fa79f req-cf3d6264-d514-46c5-b538-9335148f3790 service nova] Lock "a9322d2a-d1ff-4efc-9642-db657de18998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:54.384195 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-55c0af3e-0409-486d-99f1-13f4292fa79f req-cf3d6264-d514-46c5-b538-9335148f3790 service nova] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Processing event network-vif-plugged-ed85f952-39c4-422f-afd3-fa1c9eec4f97 {{(pid=98213) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} May 27 21:04:54.527948 np0000001553 nova-compute[98213]: DEBUG nova.network.neutron [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Updating instance_info_cache with network_info: [{"id": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "address": "fa:16:3e:ef:87:d5", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2bc0b8c-41", "ovs_interfaceid": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98213) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} May 27 21:04:54.788724 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-bce2b73e-b3e2-479e-b799-a120a7cbf5ee tempest-DeleteServersTestJSON-1578533523 tempest-DeleteServersTestJSON-1578533523-project-member] Lock "a9faa280-cc00-4b18-8ef8-a5eb7408d655" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 10.865s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:55.013782 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Started> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:55.014475 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98213) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} May 27 21:04:55.014694 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] VM Started (Lifecycle Event) May 27 21:04:55.018245 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Guest created on hypervisor {{(pid=98213) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} May 27 21:04:55.024760 np0000001553 nova-compute[98213]: INFO nova.virt.libvirt.driver [-] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Instance spawned successfully. May 27 21:04:55.025218 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} May 27 21:04:55.032429 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Releasing lock "refresh_cache-9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d" {{(pid=98213) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} May 27 21:04:55.034265 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Instance network_info: |[{"id": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "address": "fa:16:3e:ef:87:d5", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2bc0b8c-41", "ovs_interfaceid": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98213) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} May 27 21:04:55.038408 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Start _get_guest_xml network_info=[{"id": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "address": "fa:16:3e:ef:87:d5", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2bc0b8c-41", "ovs_interfaceid": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'image_id': '58b1bbfa-5e93-4445-8446-fffa20b98b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} May 27 21:04:55.044134 np0000001553 nova-compute[98213]: WARNING nova.virt.libvirt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. May 27 21:04:55.046023 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='58b1bbfa-5e93-4445-8446-fffa20b98b42', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-143728852', uuid='9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d'), owner=OwnerMeta(userid='bc3a4342c86f437986a3c05ea178bec8', username='tempest-ServerRescueNegativeTestJSON-1361072921-project-member', projectid='1acfdacf68cd433a94e1b4e91cfc6ffc', projectname='tempest-ServerRescueNegativeTestJSON-1361072921'), image=ImageMeta(id='58b1bbfa-5e93-4445-8446-fffa20b98b42', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "address": "fa:16:3e:ef:87:d5", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2bc0b8c-41", "ovs_interfaceid": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779915895.0454998) {{(pid=98213) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} May 27 21:04:55.050057 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V1... {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}} May 27 21:04:55.050057 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU controller missing on host. {{(pid=98213) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}} May 27 21:04:55.050721 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Searching host: 'np0000001553' for CPU controller through CGroups V2... {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}} May 27 21:04:55.051179 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.host [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU controller found on host. {{(pid=98213) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}} May 27 21:04:55.052467 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98213) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} May 27 21:04:55.052951 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-27T20:59:08Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-27T20:58:50Z,direct_url=,disk_format='qcow2',id=58b1bbfa-5e93-4445-8446-fffa20b98b42,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='ab239bcc1f08484389cba2a5a08ec59c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-05-27T20:58:53Z,virtual_size=,visibility=), allow threads: True {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} May 27 21:04:55.053397 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Flavor limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} May 27 21:04:55.053397 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Image limits 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} May 27 21:04:55.053560 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Flavor pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} May 27 21:04:55.054066 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Image pref 0:0:0 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} May 27 21:04:55.055190 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} May 27 21:04:55.055190 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} May 27 21:04:55.055190 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} May 27 21:04:55.055190 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Got 1 possible topologies {{(pid=98213) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} May 27 21:04:55.055190 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} May 27 21:04:55.055190 np0000001553 nova-compute[98213]: DEBUG nova.virt.hardware [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98213) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} May 27 21:04:55.072829 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-143728852',display_name='tempest-ServerRescueNegativeTestJSON-server-143728852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverrescuenegativetestjson-server-143728852',id=25,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALy7LpJNPgPVbWtWe0S1NZNS2ZRvJFbMm5ZiwzQ5S79JhZy6TvR8k+IwuAWeTjOitn1yUf77s0dUlfSpi4H28TVWf9/WmSbogcMNqU8jDUs2jmZ6Rpt7B4pL2a/Pv7Spg==',key_name='tempest-keypair-1135610000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1acfdacf68cd433a94e1b4e91cfc6ffc',ramdisk_id='',reservation_id='r-036bscvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1361072921',owner_user_name='tempest-ServerRescueNegativeTestJSON-1361072921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc3a4342c86f437986a3c05ea178bec8',uuid=9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "address": "fa:16:3e:ef:87:d5", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2bc0b8c-41", "ovs_interfaceid": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:04:55.073047 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converting VIF {"id": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "address": "fa:16:3e:ef:87:d5", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2bc0b8c-41", "ovs_interfaceid": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:55.073823 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:87:d5,bridge_name='br-int',has_traffic_filtering=True,id=f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2bc0b8c-41') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:55.076328 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:55.482477 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Acquiring lock "interface-c14c8d62-737e-4297-88bf-f9ee3cc16dfa-4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4" by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:55.482796 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "interface-c14c8d62-737e-4297-88bf-f9ee3cc16dfa-4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4" acquired by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:55.517828 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:55.519620 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98213) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} May 27 21:04:55.542293 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Found default for hw_cdrom_bus of ide {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:55.542586 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Found default for hw_disk_bus of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:55.543043 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Found default for hw_input_bus of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:55.544206 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Found default for hw_pointer_model of None {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:55.544734 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Found default for hw_video_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:55.545301 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Found default for hw_vif_model of virtio {{(pid=98213) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} May 27 21:04:55.577748 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] End _get_guest_xml xml= May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d May 27 21:04:55.577748 np0000001553 nova-compute[98213]: instance-00000019 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 196608 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 1 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-server-143728852 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 2026-05-27 21:04:55 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 192 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 1 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 0 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 0 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 1 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: True May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: bare May 27 21:04:55.577748 np0000001553 nova-compute[98213]: qcow2 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 1 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 0 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: virtio May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-1361072921-project-member May 27 21:04:55.577748 np0000001553 nova-compute[98213]: tempest-ServerRescueNegativeTestJSON-1361072921 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:04:55.577748 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d May 27 21:04:55.577748 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: hvm May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 128 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: 1 May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: Nehalem May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: /dev/urandom May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: May 27 21:04:55.577748 np0000001553 nova-compute[98213]: {{(pid=98213) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} May 27 21:04:55.580516 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] [instance: 9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d] Preparing to wait for external event network-vif-plugged-f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f {{(pid=98213) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} May 27 21:04:55.580516 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Acquiring lock "9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:55.580516 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:55.580516 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Lock "9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:55.580516 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-27T21:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-143728852',display_name='tempest-ServerRescueNegativeTestJSON-server-143728852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-serverrescuenegativetestjson-server-143728852',id=25,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALy7LpJNPgPVbWtWe0S1NZNS2ZRvJFbMm5ZiwzQ5S79JhZy6TvR8k+IwuAWeTjOitn1yUf77s0dUlfSpi4H28TVWf9/WmSbogcMNqU8jDUs2jmZ6Rpt7B4pL2a/Pv7Spg==',key_name='tempest-keypair-1135610000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001553',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1acfdacf68cd433a94e1b4e91cfc6ffc',ramdisk_id='',reservation_id='r-036bscvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1361072921',owner_user_name='tempest-ServerRescueNegativeTestJSON-1361072921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-27T21:04:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc3a4342c86f437986a3c05ea178bec8',uuid=9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "address": "fa:16:3e:ef:87:d5", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2bc0b8c-41", "ovs_interfaceid": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} May 27 21:04:55.580874 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converting VIF {"id": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "address": "fa:16:3e:ef:87:d5", "network": {"id": "df760d33-a56c-4a8e-898d-4f97375a378e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-969397372-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "1acfdacf68cd433a94e1b4e91cfc6ffc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2bc0b8c-41", "ovs_interfaceid": "f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:55.580874 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:87:d5,bridge_name='br-int',has_traffic_filtering=True,id=f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2bc0b8c-41') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:55.580874 np0000001553 nova-compute[98213]: DEBUG os_vif [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:87:d5,bridge_name='br-int',has_traffic_filtering=True,id=f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2bc0b8c-41') {{(pid=98213) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} May 27 21:04:55.580874 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:55.580874 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:55.580874 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} May 27 21:04:55.582649 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:55.582789 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b210ef26-68ae-58ab-83de-f0f6a47b169a', '_type': 'linux-noop'}}, row=False) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:55.586126 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:55.586126 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:55.586126 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:55.587410 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 12 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:55.587598 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2bc0b8c-41, may_exist=True, interface_attrs={}) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:55.587869 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2bc0b8c-41, col_values=(('qos', UUID('06fba3b5-6e42-49d9-bdb8-3c99cee2e64f')),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:55.588092 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2bc0b8c-41, col_values=(('external_ids', {'iface-id': 'f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:87:d5', 'vm-uuid': '9cec3fc6-0fd1-4cee-8d21-0f60017b0c1d'}),), if_exists=True) {{(pid=98213) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 27 21:04:55.588926 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:55.590048 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} May 27 21:04:55.597016 np0000001553 nova-compute[98213]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98213) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} May 27 21:04:55.600353 np0000001553 nova-compute[98213]: INFO os_vif [None req-0214bb8f-74c0-42e1-862c-f9efecf83f1a tempest-ServerRescueNegativeTestJSON-1361072921 tempest-ServerRescueNegativeTestJSON-1361072921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:87:d5,bridge_name='br-int',has_traffic_filtering=True,id=f2bc0b8c-4150-4cfe-b8e1-64becbc38a7f,network=Network(df760d33-a56c-4a8e-898d-4f97375a378e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2bc0b8c-41') May 27 21:04:55.825240 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [None req-6362de44-6035-401f-b91c-70be143d17bd tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lock "c14c8d62-737e-4297-88bf-f9ee3cc16dfa" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.575s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:55.987802 np0000001553 nova-compute[98213]: DEBUG nova.objects.instance [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Lazy-loading 'flavor' on Instance uuid c14c8d62-737e-4297-88bf-f9ee3cc16dfa {{(pid=98213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} May 27 21:04:56.022949 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] During sync_power_state the instance has a pending task (spawning). Skip. May 27 21:04:56.023306 np0000001553 nova-compute[98213]: DEBUG nova.virt.driver [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] Emitting event Paused> {{(pid=98213) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} May 27 21:04:56.023376 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-1af94da8-05bd-4485-bd13-4a31bb8cc452 None None] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] VM Paused (Lifecycle Event) May 27 21:04:56.051496 np0000001553 nova-compute[98213]: INFO nova.compute.manager [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Took 9.36 seconds to spawn the instance on the hypervisor. May 27 21:04:56.051804 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-a5c020d2-da58-4ef1-bb67-977888295ee4 tempest-ServerActionsTestOtherA-113699651 tempest-ServerActionsTestOtherA-113699651-project-member] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Checking state {{(pid=98213) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} May 27 21:04:56.207687 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [None req-dafe0c05-124a-40e3-8e2e-a563cc113419 tempest-AttachVolumeMultiAttachTest-1088868426 tempest-AttachVolumeMultiAttachTest-1088868426-project-member] [instance: d92e4c8c-8850-42c6-b960-09e248044889] Stashing vm_state: active {{(pid=98213) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} May 27 21:04:56.454676 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ee80c1f5-9061-4e37-8759-a8e104486845 req-b29632b1-abd7-4feb-b7d2-2219348f3ffa service nova] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Received event network-vif-plugged-ed85f952-39c4-422f-afd3-fa1c9eec4f97 {{(pid=98213) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} May 27 21:04:56.454676 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ee80c1f5-9061-4e37-8759-a8e104486845 req-b29632b1-abd7-4feb-b7d2-2219348f3ffa service nova] Acquiring lock "a9322d2a-d1ff-4efc-9642-db657de18998-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 27 21:04:56.454676 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ee80c1f5-9061-4e37-8759-a8e104486845 req-b29632b1-abd7-4feb-b7d2-2219348f3ffa service nova] Lock "a9322d2a-d1ff-4efc-9642-db657de18998-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 27 21:04:56.454676 np0000001553 nova-compute[98213]: DEBUG oslo_concurrency.lockutils [req-ee80c1f5-9061-4e37-8759-a8e104486845 req-b29632b1-abd7-4feb-b7d2-2219348f3ffa service nova] Lock "a9322d2a-d1ff-4efc-9642-db657de18998-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98213) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 27 21:04:56.454676 np0000001553 nova-compute[98213]: DEBUG nova.compute.manager [req-ee80c1f5-9061-4e37-8759-a8e104486845 req-b29632b1-abd7-4feb-b7d2-2219348f3ffa service nova] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] No waiting events found dispatching network-vif-plugged-ed85f952-39c4-422f-afd3-fa1c9eec4f97 {{(pid=98213) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} May 27 21:04:56.454676 np0000001553 nova-compute[98213]: WARNING nova.compute.manager [req-ee80c1f5-9061-4e37-8759-a8e104486845 req-b29632b1-abd7-4feb-b7d2-2219348f3ffa service nova] [instance: a9322d2a-d1ff-4efc-9642-db657de18998] Received unexpected event network-vif-plugged-ed85f952-39c4-422f-afd3-fa1c9eec4f97 for instance with vm_state active and task_state None. May 27 21:04:56.491055 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.vif [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-27T21:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1684979265',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000001553',hostname='tempest-device-tagging-server-1684979265',id=19,image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABNarNLahDnng7/wSw1U6VJLJIZ1Fxfgc8+XlIMoOiZvjeGdsfxl/D5ByDbf+lIN+rOYuVHGWI9P2IXAYVEu/i/jFpvvcmq0kuMQuuhLXndBD8rPL3i0TKKC7m9cQx9hQ==',key_name='tempest-keypair-799556134',keypairs=,launch_index=0,launched_at=2026-05-27T21:03:51Z,launched_on='np0000001553',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000001553',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='5d3d950b316142468c97cb18a90f7492',ramdisk_id='',reservation_id='r-jflni0f0',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='58b1bbfa-5e93-4445-8446-fffa20b98b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-125489879',owner_user_name='tempest-TaggedAttachmentsTest-125489879-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-05-27T21:03:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f824052f16e642148868fa2d1df1f3db',uuid=c14c8d62-737e-4297-88bf-f9ee3cc16dfa,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "address": "fa:16:3e:a8:47:0b", "network": {"id": "955decd4-cb14-477b-915e-e299dd140660", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-601472937", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b216ef0-5d", "ovs_interfaceid": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98213) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} May 27 21:04:56.491228 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Converting VIF {"id": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "address": "fa:16:3e:a8:47:0b", "network": {"id": "955decd4-cb14-477b-915e-e299dd140660", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-601472937", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d3d950b316142468c97cb18a90f7492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b216ef0-5d", "ovs_interfaceid": "4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} May 27 21:04:56.491665 np0000001553 nova-compute[98213]: DEBUG nova.network.os_vif_util [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:47:0b,bridge_name='br-int',has_traffic_filtering=True,id=4b216ef0-5d47-4e80-bbfd-069f6a2fd1f4,network=Network(955decd4-cb14-477b-915e-e299dd140660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b216ef0-5d') {{(pid=98213) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} May 27 21:04:56.492951 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] looking for interface given config: {{(pid=98213) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} May 27 21:04:56.493990 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] looking for interface given config: {{(pid=98213) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} May 27 21:04:56.494899 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.driver [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] Attempting to detach device tap4b216ef0-5d from instance c14c8d62-737e-4297-88bf-f9ee3cc16dfa from the persistent domain config. {{(pid=98213) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} May 27 21:04:56.495098 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] detach device xml: May 27 21:04:56.495098 np0000001553 nova-compute[98213]: May 27 21:04:56.495098 np0000001553 nova-compute[98213]: May 27 21:04:56.495098 np0000001553 nova-compute[98213]: May 27 21:04:56.495098 np0000001553 nova-compute[98213]: May 27 21:04:56.495098 np0000001553 nova-compute[98213]: May 27 21:04:56.495098 np0000001553 nova-compute[98213]: May 27 21:04:56.495098 np0000001553 nova-compute[98213]: {{(pid=98213) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} May 27 21:04:56.498965 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] looking for interface given config: {{(pid=98213) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} May 27 21:04:56.501682 np0000001553 nova-compute[98213]: DEBUG nova.virt.libvirt.guest [None req-9cdab6d2-39a9-49a4-a639-e99a60851658 tempest-TaggedAttachmentsTest-125489879 tempest-TaggedAttachmentsTest-125489879-project-member] interface for config: not found in domain: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: instance-00000013 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: c14c8d62-737e-4297-88bf-f9ee3cc16dfa May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: tempest-device-tagging-server-1684979265 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 2026-05-27 21:04:38 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 192 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 1 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 0 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 0 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 1 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: True May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: bare May 27 21:04:56.501682 np0000001553 nova-compute[98213]: qcow2 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 1 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 0 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: ide May 27 21:04:56.501682 np0000001553 nova-compute[98213]: virtio May 27 21:04:56.501682 np0000001553 nova-compute[98213]: pc May 27 21:04:56.501682 np0000001553 nova-compute[98213]: virtio May 27 21:04:56.501682 np0000001553 nova-compute[98213]: virtio May 27 21:04:56.501682 np0000001553 nova-compute[98213]: virtio May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: tempest-TaggedAttachmentsTest-125489879-project-member May 27 21:04:56.501682 np0000001553 nova-compute[98213]: tempest-TaggedAttachmentsTest-125489879 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 196608 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 196608 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 1 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 1 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: /machine May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: OpenStack Foundation May 27 21:04:56.501682 np0000001553 nova-compute[98213]: OpenStack Nova May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 33.1.0 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: c14c8d62-737e-4297-88bf-f9ee3cc16dfa May 27 21:04:56.501682 np0000001553 nova-compute[98213]: c14c8d62-737e-4297-88bf-f9ee3cc16dfa May 27 21:04:56.501682 np0000001553 nova-compute[98213]: Virtual Machine May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: hvm May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: 131072 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: Nehalem May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: destroy May 27 21:04:56.501682 np0000001553 nova-compute[98213]: restart May 27 21:04:56.501682 np0000001553 nova-compute[98213]: destroy May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: /usr/bin/qemu-system-x86_64 May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]:
May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]:
May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]:
May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]:
May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]:
May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.501682 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: May 27 21:04:56.509956 np0000001553 nova-compute[98213]: